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Preface 


This book is targeted primarily toward engineers and engineering students of ad- 
vanced standing (Sophomores,，seniors and graduate students). Familiarity with a 
computerlanguage is required; knowledge ofbasic engineering subjects is useful but 
not esSSential. 

The text attempts to place emphasis on numerical methods, not programming. 
Most engineers are not pIogrammers, but problem solvers. They want to know what 
methods can be appliedto a given problem, what are their strengths and pitfalls and 
howto imnplementthem. Engineers arenotexpectedto write computer code for basic 
tasks from scratch; they are more likelyto utilize functions and subroutines that have 
been already written and tested. Thus programming byengineers is largely confined 
to assembling existing pieces ofcode into a coherentpackagethat solves the problem 
athand. 

The piece" of code is usually a function that implements a Specific task. For the 
Userthe details ofthe code are unimportant. What matters is the interface (what goes 
in and what comes oub and an understanding ofthe method on which the algorithm 
is based. Since no numerical algorithm is infallible, the importance ofunderstanding 
the underlying method cannot be overemphasizedi; it is, in fact the rationale behind 
learning numerical methods. 

This book attempts to conform to the views outlined above. Each numerical 
method is explained in detail and its shortcomings are pointed out. The examples 
thatfollowindividualtopics fall into two categories:handcomputations thatillustrate 
the inner workings of the method, and small programs that show how the computer 
codeis utilizedin solvingaproblem. Problems thatrequire programming are marked 
With 国 . 

The material consists of the usual topics covered in an engineering course on 
numerical methods: solution of equations, interpolation and data fitting, numerical 
differentiation and integratiomn, Solution of ordinary differential equations and eigen- 
value problems. The choice of methods within each topic is tilted toward relevance 
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to engineering prIoblems. For example, there is an extensive discussion of symmetric， 
Sparsely populated coeffticient matrices in the solution of simultaneous equations. 
In the same vein, the solution of eigenvalue problems concentrates on methods that 
ef 性 ciently extract Specific eigenvalues from banded matrices. 

An important criterion used in the selection of methods was clarity. Algorithmas 
requiring overly complexbookkeeping wererejectedregardless oftheir efficiency and 
Iobustness. This decision, which was taken with great reluctance, is in keeping with 
the intent to avoid emphasis on programming. 

The selection of algorithms was also influenced by current practice. This dis- 
qualified several well-known historical methods that have been overtaken by more 
Iecent developments. For example, the secant method for finding roots ofequations 
was omitted as having no advantages over Brents method. For the same Ieasomn, the 
muljtistep methods used to solve differential equations (e.g., Milne and Adams meth- 
ods) were left out in favor of the adaptive Runge-Kutta and Bulirsch-Stoer methods. 

Notably absent is a chapter on partial differential equations. It was felt that this 
topicis besttreatedbyfiniteelementorboundaryelementmethods, which are outside 
the scope of this book. The finite difference model which is commonly introduced 
in numerical methods texts, is just too impractical in handling multidimensional 
boundary value problems. 

As usual, the book contains more material than can be covered in a three-credit 
couUISe. The topics that can be Skipped without loss of continuity are tagged with an 
asterisk (5 

The programs listed in this book were tested with MATLABS 6.5.0 and under 
Windows8 XP The source code can be downloaded from the books website at 


www.cambridge.org/0521852889 


The author wishes to express his gratitude to the anonymous Ieviewers and 
Professor Andrew Pytel for their suggestions for improving the manuscript. Credit 
is also due to the authors of Nz77azerical Recipes (Cambridge University Press) whose 
presentation ofnumerical methods was inspirational in writing this book. 


1.1 





Introduction to MATLAB 


General Information 
Quick Overview 


This chapter is not intended to be a comprehensive manual of MATLAB@ Our Sole 
aim is to prIovide sufficient information to give you a good start. 二 you are familiar 
with another computerlanguage, andwe assumethatyou are,itisnot difficultto pick 
up the rest as you go0. 

MATILAB is ahigh-level computer language for scientific computing and data Vi- 
Sualization buijlt around an interactive programming environment. Itis becoming the 
premiere platform for scientiftic computing at educational institutions and research 
establishments. The great advantage of an interactive System is that programs can be 
testedand debugged quickly allowing the userto concentrate more on the principles 
behind the program and less on pIogramming itself. Since there is no need to com- 
pijle, link and execute after each correctiom MATLAB programs can be developed in 
Imuch shorter time than equivalent FORITRAN or C programs. On the negative Side， 
MAILAB does not produce stand-alone applications 一 the programs can be run only 
on computers that have MATLAB installed. 

MATILAB has other advantages over mainstream languages that contribute to 
Iapid program development: 


。 MATILAB contains a large number of functions that access pIoven numerical 1i- 
braries,sSuch asLINPACKandEISPACK.Thismeansthatmanycommontasks (e.g.， 
solution of simultaneous equations) can be accomplished with a single function 
call. 

。 There is extensive graphics Support that allows the results of computations to be 
plotted with a few statements. 

。 Allnumerical objects aretreated as double-precision arrays.Thusthereisnoneed 
to declare data types and carry out type coOnversions. 
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The syntax of MATLAB resembles that ofFORITRAN. To getanidea ofthe similari- 
ties,letus comparethe codes writteninthetwolanguagesforsolution ofsimultaneous 
equations Ax = b by Gauss elimination. Here is the subroutine in FORITRAN 90: 


SuUubroutine gauss(A,b,n) 
Use Prec_mod 
Imp1icit Pone 


Teal(DP)，dimension(:，:)，intent(in out) :: A 


可 


TealLl(DP) ，dimension(C:) ， Intemnt(Cin outI) 
Integez，1intent(iny) 
Freal(DP) :: Lambda 


Integez  :: 工 ,K 


IfE(A(CI,Kk) /= 0) then 
ambda = ACTI,K)/ACK,K) 
A(CI,Kk+1:n) = ACTI,Kk+l:n) - ampbdax*A(CK,Kk+1:n) 
b(i) = b(Ci) - Lambdax*b(Ck) 


end 工 工 


do K = mn, 工 ,= 

b(Kk) = (Pb(CK) - sumCACK,Kk+1:n)*bCk+1l:n)))VXACK,K) 
end do 
TeturDn 


end subroutine gauss 


The statement use prec_mod tells the compiler to load the module prec_mod 
(not shown herej, which defines the word length DP for floating-pointnumbers.Also 
note the use of array sections, Such as a(Ck,k+1l1:n), afeature that was not available 
in previous veIsions of FORITRAN. 

The equivalent MATILAB function is (MAILAB does nothave subroutines): 


function b = gauss(A,b) 
n = LengthCb) ; 
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if AGI,k) "= 0 
ambda = ACTI,K)/XACK,K) ; 
A(I,Kk+1:n) = ACTI,k+lL:n) - ambdaxA(CKk,Kk+1:n) ; 
b(Ci)= b(GI) - Lambdax*b(CK) ; 


emnd 


for KkK = mn:-1: 工 
b(K) = (b(Ck) - ACK,K+1:n)x*bCKk+L:n))XACGK,K) ; 


end 


Simultaneous equations can also besolvedin MATLAB with the simple command 
A\b (See below). 

MATILAB can be operated in the interactive mode through its command window， 
where each command is executed imnmediately upon its entry In this mode MATLAB 
acts like an electronic calculator. Here is an example of an interactive Session for the 
solution of simultaneous equations: 


>> A= [210;) -122;01 4]; % Input 3X3 matriX 
> 六 生 二 - 卫 2 % Input column Vector 
>> Soln = AN\b % Solve Ax*X = b by left division 
Soln = 
0.2500 
0.5000 
0.6250 


The symbol >> is MAILAB'S prompt for input. The percent sign (%) marks the 
beginning of a comment. A semicolon (;)) has two functions: it Suppresses printout 
of intermediate results and separates the rows of a matrix. Without a terminating 
Semicolon, the result of a command would be displayed. For example, omission of 
the last semicolon in the line defining the matrixA would result in 


>>A= [210;) -1122;014] 
起 三 


一 工 2 2 
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Functions and programs can be created with the MATLAB editor/debugger and 
saved with the .m extension (MAILAB calls them M-fles). The file name of a saved 
function should be identical to thename ofthe function. For example, ithe function 
for Gauss elimination listed above is saved as gauss.m, it can be called just like any 
MATLAB function: 


>>A= [210; -122; 01 4]; 
>>b= [1;， 2;， 3]) 
>> Soln = gauss(A,b) 
Soln = 
0.2500 
0.5000 
0.6250 


Data Types and Variables 
Data Types 


The most commonly used MAILAB data types,，oTI classes, are dqouble，char and 
logical，all of which are considered by MATLAB as arrays. Numerical objects 
belong to the class double，which represents double-precision arrays; a scalar is 
treated as al1x1larray IThe elements of a char type array are strings (Sequences 
of characters), whereas a logical type array element may contain only 1 (true) or 0 
(false). 

Another important class is function_handle, which is unique to MAITLAB. It 
contains information requiredto find and execute afunction. Thename ofafunction 
handle consists of the character @, followed by the name of the function; e.g.,@sin. 
Eunctionhandles areusedas inputarguments in function calls. For exzample,Suppose 
that we have a MAILAB function plJot(func,x1,x2) that plots any User-specified 
function func from xl to x2. The function call to plot sinx from 0 to rr would be 
plLot(Casin,0,pPI). 

Thereareotherdatatypes,butweseldom comeacrosstheminthistext.Additional 
classes can be defined by the user. The class of an object can be displayed with the 
class command. For example， 


>>X=1+31 % Complex numbez 
>> Class(CX) 

ans = 

doubJle 
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Variables 


Variable names, which must start with a letter are case Se11S11ive. Hence xstart and 
XxStart Iepresent two different variables. The length of the name is unlimited, but 
only the first N characters are signifticant. To find Ntforyour installation of MATLAB， 
Use the command nameJengthmax: 


>> PamelLengthmaX 
ans = 
63 


Variables that are defined within a MAILAB function are local in their scope. 
They are not available to other parts of the program and do not remain in memory 
after exiting the function (this applies to most programming languages). HoweveD， 
variables canbesharedbetweenafunctionandthecallingprogramiftheyare declared 
glLobal. For example, by placing the statement global X Yin afunction as well as 
the calling program, the variablesXandY are shared between the two pIogram Units. 
The recommended practice is to use capital letters for global variables. 

MATILAB contains severalbuilt-in constantsandspecialvariables,mostimnportant 
of which are 



































ans Default name for results 

eps Smallestnumberfor whichn 1 + eps > 工 
inf Infinity 

NaN Notanumber 

荆 or 了 一 1 

利于 元 

realmin | Smallestusable positive number 
realmax | Largest Usable positive number 





Here are a few of examples: 
>> Warnjing off  ”% Suppresses Print of warning messages 


>> 5/0 


amnsS = 三 


>> 0X0 
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>> 5x*NaN % Most operations with NaN result :in NaN 
amns = 
NaN 


>> NaN == NaN % Different NaN 's are not equall 
ans = 
0 


>> epbs 
ans 一 
2.2204e-016 


Arrays 


Arrays can be created in several ways. One ofthem is to type the elements ofthe array 
between brackets. The elements in each row mustbe separated byblanks or commas， 
Here is an example of generatinga3 x 3 matrix: 


> 人 三 下 2 EL 0 


下、 公 二 下 
0 1 -了 
旺 二 
2 = 汪 0 
志 王 2 = 王 
0 = 灶 
The elements can also be typed on a single line, separating the rows with semi- 
Colons: 


>>A= [2 -10; -12 -1; 0 -11] 


到 -三 
2 三 并 0 
兰 王 和 二 外 
0 一 工 工 


Unlike most computer languages, MATLAB differentiates between IOow and col- 
ummn vectors (this pecujliarity is a frequent source of programming and input errors). 
For example， 
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> 全 和 三 = 下 于 有 : 立 ] % Row VectoT 
b = 
工 和 吕 
> 三 23 33] % _ Column vecto 
b = 
2 
> 二 下 有 二 % Transpose of Tow Vecto 
b = 
2 


Thesingle quote (") is the 1a1spose opeJatorin MAILAB;thusb' isthetranspose 
of b. 
The elements of a matrix, Such as 


4 4 4is 
A=| 4 4 423 
431 4 433 
can be accessed with the statementA(GI ,j), whereiand j are the row and column 


numbers, respectively. A section of an array can be extracted by the use of colon 
notation. Here is an ilustration: 


>>A= [816;357;49 2] 


A = 

8 于 

4 9 
>> A(2 ,3) % ELement in row 2，column 3 
amns = 

7 


>> A(C:，2) % Second colLumn 
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>> A(2:3,2:3) % The 2 X 2 SubmatrixX :in Lowez TiIght Cornez 


ansS = 三 


Array elements can also be accessed with a single index. Thus A(Ci) extracts the 
ith element ofA, counting the elements down the columns. For example, AC7) and 
A(1,3) would extract the same elementfroma3 x3matrix. 


Cells 

Acell array is a sequence of arbitrary objects. Cell arrays can be created by enclosing 
their contents between braces {}. For example, a cell array c consisting of three cells 
can be created by 

>> C={[123]，"one two three"，6 + 7I+h 


[1x3 adqouble] "one 廿 WO 廿 Free [6.0000+ 7.00001iI] 


As seen above, the contents of some cejlls are not printed in order to save Space. 
Hall contents are to be displayed, use the celldisp command: 


>> Cell1disp(Cc) 


ct1}+ = 
工 2 3 
ct2}+ = 
one twoO three 
cf{t31 = 


6.0000 + 7.00001L 


Braces are also used to extract the contents ofthe cells: 


三 这 二 二 % First cel1 


ans = 
工 2 3 
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>> cf1+(2) % Second element of first cel1 
ans = 
之 
之 区 2 % Second cel1 
ans = 


one twoO three 


Strings 


Astringisasequence ofcharacters;itistreatedbyMATILAB asacharacter array. Strings 
are createdbyenclosingthe characters between single quotes. They are concatenated 
with the function stzcat, whereas a colon operator (:) is used to extractaportion of 
the string. For example， 


>> S1L = "Press Teturn toO exIit ”; % _ Create a String 

>> S2 = ”the program'”; % _ Create another String 

>> S3 = Strcat(s1,s2) % Concatenate S1L and SS2 

S3 = 

Press Teturn to ex1it the Program 

>> S4 = SLC1L:12) % EXtract chars. 1-12 of sL 
S4 = 


Press Feturmn 


Operators 
Arithmetic Operators 


MAILAB supports the usual arithmetic operators: 





十 | Addition 





一 | Subtraction 














* | Multiplication 


Exponentiation 





When applied to matrices, they perform the familiar matrix operations, as jllus- 
trated below. 


六 从 三 之 .有 2]5 


>> AT+B % MatTrix addition 
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ans = 
10 12 
4 6 8 
>> Ar*B” % MatzIx multiplication 
ans = 
50 8 
122 7 
>> Ar*B % Matrix multiplication fails 
??? ETrror Using ==> * % due to incompatible dimensions 


Inner matrix dimensions must agree . 


There are two division operators in MATLAB: 





/ | Right division 


\ | Left division 

















Haandb are scalars, the right division a/b results in a divided byb, whereas the left 
division is equivalentto byva. In the casewhereAandB arematrices, A/B returns the 
Solution ofX*A = BandANBYyields the solution ofA*X = B. 

Often we need to apply the *, / and "operations to matrices in an element-by- 
element fashion. This can be done by preceding the operator with a period (.) as 
follows: 





Element-wise multiplication 





./ | Element-wise division 














Element-wise exponentiation 





FEor example, the computation Ci = 4 Bi can be accomplished with 


V 
V 
三 
中 


[ 工 了 .3 生 5 6] 了 三 【789 人 工 志 ]3 
>> C = A.*B 
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Comparison Operators 


The comparison (relational) operatorsreturn 1fortrueand0forfalse.Theseoperators 


are 





< | Less than 





> | Greater than 





<= | Less than or equal to 





>= | Greaterthan or equal to 





== | Equal to 














“= | Notequalto 





The comparison operators always act element-wise on matrices; hence theyTresult in 
amatrix oflogical type. For example， 


>> A= [1 2 3; 45 6]7 3= [7.8 97 .01 工 过 ]; 
> 办 入 -有 


amns 三 


Logical Operators 


The logical operators in MATLAB are 





& | AND 
| | oOR 
- | NOT 




















They are used to build compound relational expressions，an example of which is 


Shown below. 


六 人 三 下 之] 了 7 9 0 2]3 
>> (A> B) | (CB > 5) 


amnsS = 三 


胡 Intoduction te MATLAB 


1.4 


Flow Control 
Conditionals 


让 else, else 计 
The if construct 


IE co1C 龙 oO7 
DiocK 
end 


executes the Diock of statements 让 the co1pdifo7 is true. Hthe condition is false， 
the block skipped. The if conditional can be followed by any number of elseif 
Constructs: 


fE co1C7 丰 Oo7 
DiocK 

elseif co1C17 龙 Oo7 
DiocK 


end 


which work in the same manner. The else clause 


ese 
DiocK 


emnd 


can be Used to define the block of statements which are to be executed 让 none of 
the if-elseifclauses are true. The function signumbelowillustrates the use ofthe 
conditionals. 


function sgn = Signum(a) 
Ifa> 0 

Sgm = 工 ; 
elselif a < 0 

Sgmn = -1; 


else 


>> SIgnum (人 -1.5) 
ans = 
=- 工 


Switch 
The switch construct is 


Switch exXjPp1esS107 
case VCGI1e1i 
DiocK 
case VC1e2 
DiocK 


otherwise 
BDIocK 


end 


Herethe expressiom is evaluatedandthe controlispassedtothe casethatmatches the 
value.Forinstance, 计 thevalue ofexpressiom is equal to VCG1Ue2, the piock of statements 
following case VC1zxe2 is executed. I the value of expressio1 does not match any 
of the case values, the control passes to the optional otherwise block. Here is an 
example: 


ftunmction YY = 廿 lgCfunc ,XI) 


SWIitch func 


Case "Sin 


Y = Sin(CX) ; 


Y = tan(X) ; 
otherwise 
error('NOo such function defined ') 


end 


>> trig(C'tan' ,piI/X3) 
amns = 
工 .7321 
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Loops 


While 
The while construct 


while co17C 龙 O77: 
DocK 


emnd 


executes a Diock of statements 让 the co1pditzo7 is true. After execution of the block, 
co1difo1 is evaluated again. Ifit is still true, the block is executed again. This process 
is continued until the co7dizo7 becomes false. 

Thefollowingexample computesthenumber ofyearsittakesfora$1000Pprincipal 
to grow to $10,000 at 6 兄 annual interest. 


>> D = 1000; years = 0 
>> while P < 10000 
years = years 二 工 ; 
DPD= 了 pxr(1LI+0.06); 
end 
>> YearS 
Years = 
40 


for 
The for loop requires a 1a1gef and a Seqge1ce over which the target ljoops. The form 
ofthe construct is 


for 1O1gel = SeqgMe1ce 
DiocK 


emnd 


For example, to compute cosxfromx=0tor/2atincrements ofr/10we could 
USse 


>> forn= 0:5 %mn loops over the sedqduence 012345 
YCn+ILI) 
end 


CosS(Cnx*pPI/X1L0) ; 


工 .0000 0.9511 0.8090 0.52878 0.3090 0.0000 
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Loops should be avoided whenever possible in favor of vectorized expressions， 
which execute much faster. A vectorized solution to the last computation would be 


>>Dn= 0:5) 
>> YY = Cos(Cnx*pI/X10) 
Y = 


工 .0000 0.9511 0.8090 0.5878 0.3090 0.0000 


break 

Any loop can be terminated by the break statement. Upon encountering a break 
Statement the control is passed to the first statement outside the loop. In the fol- 
lowing example the function buildvec constructs a IOow vector of arbitrary length 
by prompting for its elements. The process is terminated when an empty element is 
encountered. 


function X = buildvec 
主 OE 工 三 工 ? 王 000 


elem = :input( "==> "); % Prompts for Input of elLement 

If Isempty(CelLem) % _ Check for empty elLement 
break 

emnd 

X(CI) = elem; 


emnd 


>> X = buildvec 


continue 

When the continue statement is encountered in a loop, the control is passed to 
the next iteration without executing the statements in the current iteration. As an 
ilustration, considerthefollowingfunctionthatstripsalltheblanksfromthestring sl1: 


function sS2 = Strip(s1) 
S2 = ”|; % Create an empty String 
for 工 = 1:1length(Cs1) 
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IE s1(CI) == ” 

CoOnt1imnue 
ese 

S2 = Strcat(s2,sS1L(I)); % ConcatenatIon 
end 


end 


>> S2 = Strip('This Is too bad ') 
S2 = 


Thisistoobad 


return 

Atfunction normally returns to the calling program when it runs out of statements. 
However the function can be forced to exit with the return command. In the ex- 
ample below, the function solve uses the Newton-Raphson method to fnd the zero 
of 帮 x) = sinx--0.5Xx. The input x (guess of the solution) is refined in successive 
iterations using the formula x 熏 X 十 Az where Ax= 一 0/ 广 until the change 
Ax becomes sufhiciently small. The procedure is then terminated with the retuznm 
statement. The for loop assures that the number of iterations does not exceed 30， 
which should be more than enough for convergence. 


function X = SolLve(X) 
for mnumItez = 1:30 
qdqX = -(slin(CX) - 0.5*X)/(Ccos(X) - 0.5); % -ECxX)VE (XI) 
又 ==X+ dxi 
If abs(dqx) < 1.0e-6 % _ Check for convezgemnce 
TetuTrDn 
end 
end 


error(' TIToo many IteratiIons ) 


>> X = Solve(2) 
一 
1.8955 


eTTOT 
Execution of a program can be terminated and a message displayed with the erzoT 
function 


SnoweEssCXSeE 


For exzample, the following program lines determine the dimensions of a matrix and 
aborts the program 让 the dimensions are not equal. 
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[m,n] = size(A); %m= no. of rowsin= no. of cols. 
If m “= mn 
erTor( ”Matrix must be square ') 


emnd 


Functions 
Function Definition 


Thebody of afunction must be preceded bythe function definition line 


function [OUVIPVLGT8S] 王妃 12ctio11_120111e(172PUL CTSU12e7NS) 


The input and output arguments must be separated by commas. The number of 
arguments may be zero. Hthere is only one output argument the enclosing brackets 
maybe omitted. 

To make the function accessible to other programs units, it must be saved under 
thefilename jjctio7_7017e.m. This fle may contain otherfunctions, called SBPjc7zzc- 
1io15s. The subfunctions can be called onlybythe primary function 户 72ctio7_72C111e oOT 
other subfunctions in the fle; they are not accessible to other program Units. 


Calling Functions 


Afunction may be called with fewer arguments than appear in the function defini- 
tion. The number of input and output arguments used in the function call can be 
determinedbythe functionsmnargin andnargout,Iespectively The following exam- 
ple shows amodified version of the function solve that involves two input and two 
output arguments. The errortolerance epsilonis an optionalinputthatmaybeused 
to override the defaultvalue 1.0e-6.The output argumentnumIter, which contains 
thenumber of iterations, may also be omitted from the function call. 


function [X,numIter] = Solve(X,epsilon) 

If nargin == 工 % Spbpecify default value 工 工 
epsilon = 1.0e-6; % second input argument 工 S 

emnd % omitted :in function cal1 


for mnumIter = 1:100 
qdqX = -(sinCxX) - 0.5*X)/Ccos(CX) - 0.5); 
又 = 和 + dxi 
If abs( 人 dx) < epsIlon % Converged; treturn to 
TetuUTDn % _ calling Program 


emnd 
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end 


error( Too many IteratiIons ) 


>> X = SolLlve(2) % numIter mnot Printed 
= 

二 8955 
>> [X,numItez] = solve(2)  % numIter Is Printed 
区 = 

工 .8955 
DuUmItez = 一 

祭 


>> format ong 
>> X = Solve(2,1.0e-12) % Solving with extra precision 
X = 
1.89549426703398 
>> 


Evaluating Functions 


Let us consider a slightly different version of the function solve Shown below. The 
expression for dqx, namely Ax= 一 帮 0/ 广 oO, is now coded in the function myfunc， 
So that solve contains a call to myfunc. This will work fine, provided that myfunc is 
stored under the fle name myfunc .m so that MATLAB can find it. 


function [X,numItez] = solve(X,epsilon) 
If nargin == 1; epsilon = 1.0e-6; end 
for numItez = 1:30 

dx = myfunc(X) ; 

芝 三 匡 士 - 避 浆 ? 

If abs(dqx) < epslilon;i freturn;i end 
emnd 


error(' Too many IteratiIons ') 


function y = myfunc(X) 
YY=-(sinCx) - 0.5*X)/Ccos(CX) - 0.5); 


>> X = SolLlve(2) 
二 
工 -98955 
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In the above version of solve the function returning qx is stuck with the name 
myfunc. Ifmyfunc is replacedwith anotherfunctionname, solvewillnotworkunless 
the corresponding change is made in its code. In general itis nota good ideato alter 
computer codethathas been testedand debugged; all data should be communicated 
to a function through its arguments. MATLAB makes this possible by passing the 
function handle ofmyfunc to solve as an argument as jllustrated below. 


function [X,numIter] = Solve(Cfunc,X,epsiIilon) 

If nargin == 2; epsilon = 1.0e-6; end 

for numIter = 1:30 
dx = feval(Cftunc,X) ; % feval Is a MATLAB function for 
X=X+ dxi % evaluating a passed function 
If abs( 人 dx) < epsilon; returni;i end 

emnd 


erTror( "Too many Iterations ') 
>> X = Solve(Camyfunc,2) ”% Qmyfunc is the function handle 


工 .8955 


The call solve(Camyfunc,2)creates a function handle to myfunc and passes 计 
to solve as an argument. Hence the variable func in solve contains the handle 
to myfunc. A function passed to another function by its handle is evaluated by the 
MATLAB function 


feval (jz7jzctiom_Pa1zdje, 0178V117e11 胡 ) 


It is now possible to use solve to find a zero of any jx by coding the function 
Ax= 一 0/ 广 oO andpassing its handle to solve, 


In-Line Functions 


Ithe function is not overly complicated, it can also be ITepresented as an 11717172e 
object: 


Jactio1_11C11e = Inline(eXp1essio1 ，VG17 ，VG1Q ，….) 


Where exp1essio1 Specifies the function and va za12 ...arethenames ofthe inde- 
pendent variables. Here is an example: 


>> myfunc = :inline ('X"2 +T YY"2: XI， YI) 
>> myfunc (3 ,5) 
ans = 


34 
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The advantage of an in-line function is that it can be embedded in the body of 
the code; it does nothave to reside in an M-file. 


Inpbut/Output 
Reading Input 


The MATILAB function for receiving user input is 


ZCLUe = :input('P1o1101P1 ) 


It displays a promptand then waits for input. 太 the input is an expression, it is evalu- 
ated and returned in VC1xe. The following two samples ilustrate the use of input: 


>> a = input('”Enter exXxpression: ”) 
Entez expresslion: tan(0.15) 
总 三 


0. 工 511 


>> S = input( ”Enter String: ”) 
Entez String: ”Black sheep'， 

s = 

BlLack sheep 


Printing Output 


As mentionedbefore, theresultofa statementis printedifthe statementdoesnotend 
with a semicolon. This is the easiest way of displaying results in MAILAB. Normally 
MATILAB displays numerical results with about five digits, but this can be changed 
with the format command: 





format long | Switches to 16-digit display 














format short | Switches to 5-digit display 





To print formatted output use the fprintf function: 


DFTEEEC 各 1 人 轧 司 必 亿 


where jorrmzat contains formatting Specifications and jzsf is the list of items to be 
printed, separated by commas. Typically used formatting specifications are 


521 | 1.7 Array Manipulation 


1.7 








%IV.Cf | Floating point notation 








%.de | Exponential notation 











\n Newline character 





where wis the width ofthe field and dis thenumber of digits after the decimal point. 
Linebreakisforcedbythenewline character.Thefolowingexampleprintsaformatted 
table of sin x vs.x atintervals of 0.2: 


> 王 七 三 02202333 
>> for 工 = 1:1Length(X) 
fprintf('%4.1f %11.6fN\n',XCI) ,sinCxCI) D)D) 


end 
05.0 0.000000 
0.2 0.198669 
0 .4 0.389418 
06 0.564642 
0.8 05.717356 
工 -0 0.841471 


Array Manipulation 
Creating Arrays 


Welearnedbeforethatanarraycanbecreatedbytypingitselementsbetweenbrackets: 
>>X= [00.25 0.5 0.75 1] 
0 0.2500 0.5000 0.7500 工 .0000 


Colon Operator 
Arrays with equally spaced elements can also be constructed with the colon operator. 


X = Jirsft_ele117:772cTe111e11t:10Sf ele170 


For example， 


95253 工 
汪 到 
0 0.2500 0.5000 0.7500 工 .0000 
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linspace 
Another means of creating an array with equally spaced elements is the 1inspace 
function. The statement 


InSsDacs 太 Cs 二/ 功 


creates an array of 7 elements starting with Xjirst and ending with xlCst Here is an 
iustration: 


>> X= 1Linspace(0,1,5) 
开 三 
0 0.2500 0.5000 0.7500 1.0000 


logspace 


The function logspace is thelogarithmic counterpart oflinspace. The call 


X = 1ogspace(z21i7st,Z1CSt ,171) 


creates 71logarithmically spaced elements starting with x = 10z Jstand ending with 
X 一 10zAxt. Here is an example: 


>> X = Logspace(0,1,5) 
一 
工 .0000 瑟 SS 3.1623 5.6234 10.0000 


Zeros 
The function call 


三 OSI 让 


returns a matrix of 1 rows and 1 columns that is flled with zeroes. When the fun- 
ction is called with a single argument e.g., zeros(1)), ax7matrixis created. 


OhesS 


ETTSISIG777R7 


The function ones works in the manner as zeros, butflls the matrix with ones. 


rand 


EGG 


This function returnsamatrix flled with random numbers between 0 and 1. 
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eye 
The function eye 


及 = eye(17) 
creates an 7 x identity matrix. 


Array Functions 


There are numerous array functions in MAITLAB that perform matrix operations and 
other useful tasks. Here are afewbasic functions: 


length 
Thelength 7 number ofelements) ofavector x can be determined with the function 
ength: 
1 =1ength(X) 
Size 


Ifthe function sizeis caled with asingle input argument: 


本 77 辣 7 必 三 证 过 sg) 


it determines the number of rows 1 and number of columns 7 in the matrix X. 下 
called with two input arguments: 


1 = size(CX ,Gd117) 
it returns the length of X in the speciftied dimension (dz7702 = 1 yields the number of 
IOows, and di10 = 2 gives the number of columns). 


ITeshape 
The reshape function is used to rearrange the elements of a matrix. The call 


和 ESTNaDSGXG 77 瑟 7 


returnsa71 xmatrixthe elements ofwhich are taken from matrix X in the column- 
Wise order. The total number of elements in X must be equal to 1 x 1. Here is an 
example: 
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于 症 2 3 和平 填 


VY 
V 
几 
外 


工 3 5 7 9 1 
>> A = freshape(a,2,3) 


dot 


QG=dot(X]) 
This function returns the dot product of two vectors Xx and y which must be of the 
same length. 


prod 


QG=Prod(CX) 


Eoravectory prod(X) returmns the product ofits elements. Ifxisamatrix, then ais a 
IOwWvector containing the products over each column. For example， 


>> a= [123456]; 
>> A = Teshape(a,2,3) 
A = 


>> prod(a) 
ans = 
720 


>> prod(A) 


ans = 
2 工 2 30 


SUID 


0 三 硬 SUimO 


This function is similar to pzrod, exceptthat it returns the sum of the elements,. 
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CIOSS 


C=cross(2,5) 


The function cross computes the cross product: c=QXx 尺 where vectors Cand 
must be oflength 3. 


Writing and Running Programs 


MATILAB has two windows available for typing program lines: the co11717C71C W172CoV 
andthe editordebrxgger The command window is always in the interactive mode, So 
that any statemententeredintothe windowis imnmediatelyprocessed. Theinteractive 
mode is agood wayto experiment with the language and try out programming ideas. 
MATILAB openstheeditorwindowwhenanewM-fileis created, or an existingfile 
is opened. The editor window is used to type and Save prIograms (called sc7zPLjiies in 
MAILAB) and functions. One could also use atext editor to enter program lines, but 
theMATLAB editorhas MAILAB-specificfeatures,such as color codingandautomatic 
indentation, that make work easier. Before a program or function can be executed, 让 
must be saved as a MALILAB M-fhle (recall that these files have the .m extension). A 
pirogram can be run by invoking the rz command from the editors deprxg menu. 
When afunction is called for the first time during a program rum, it is compiled 
into P-code (pseudo-code) to speedup execution in subsequent calls to the function , 
Onecanalso createtheP-codeofafunctionandsaveitondiskbyissuingthecommand 


pcode jp12ctio7_72C111e 


MAILAB will then load the P-code (which has the .p extension)j into the memory 
rather than the text file. 

The variables created during a MATILAB session are Saved in the MATILAB 
WoOTKspace untilthey are cleared. Listing ofthe savedvariables can be displayed bythe 
command who. I 开 greater detail about the variables is required, type whos. Variables 
can be cleared from the workspace with the command 


TEST 时 


which clears the variables 书 ....Ifthelist ofvariables is omitted, all variables are 
cleared. 
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Assistance on any MATLAB function is available by typing 


in the command window-. 


Plotting 


help jctio7m_71C111e 


MATILAB has extensive plotting capabilities. Here weillustrate some basic commands 
for two-dimensional plots. The example belowplots sinxand cosxonthe same plot. 


学 


光学 


区 


每 


光环 


光 


尖 


每 


各 


条 


区 
Y 
DlLot(X YY Ko ) % 

% 
hold on % 
有 兰 - 友 OSI 人 (CR % 
PJLot(X,Z，K:X ) % 


03530223 和 了 ; % 


SIn(CX) ; % 


gid on % 
XLabel("X ) % 
YLabelL(Y ) % 
gtexXxt( sin X )  % 


gtexXxt('"cos X7D) 


Create X-arTay 

Create Y-arTay 

PlLot X-Yy pojints with specified colo 
and Symbol ("K” = black，"o' = Circles) 
A1L1ow overwTriting of current P1Lot 
Create Z-arTay 

Plot X-Z points ("X” = crosses) 
Display coordinate grid 

Display Label for X-axXlis 


Display Label for Y-axis 


Create mouse-movab]le 七 eXt 





1.9 Plotting 


Afunction stored in a M-file can be plotted with a single command, as shown 
below. 


function Yy = testfunc(x) % Stored function 


YY = (X. 3).xslinCX) - 工 ./X; 


>> fplot(Catestfunc, [1 20]) % Plot from X= 1 to 20 


>> SrId on 
8000 
6000 
4000 


2000 





2 呈 6 8 10 12 14 16 18 20 


The plots appearing in this book from here on were not produced by MATLAB. 
We used the copy/paste operation to transfer the numerical data to a Spreadsheet 
and then let the Spreadsheet create the plot. This resulted in plots more suited for 
publication . 


之 


了 .1 





Systems of Linear Algebraic Equations 


Solve the simultaneous equations Ax = b 


Introduction 


Inthis chapterwelookatthe solution of linear algebraic equations in 7 unknowns， 
It is by far the longest and arguably the most important topic in the book. There 
is a good reason for this 一 it is almost impossible to carry out numerical analysis 
of any sort without encountering simultaneous equations. Moreover equation Sets 
arising from physical problems are often very large，consuming a lot of computa- 
tional resources. It usually possible to reduce the storage redquirements and the TuUn 
time by exploiting Special properties of the _ coefficient matrix such as Sparseness 
(most elements of a sparse matrix are Zero). Hence there are many algorithms ded- 
icated to the solution of large sets of equations, each one being tailored to a partic- 
ular form of the coeffhicient matrix (Symmetric, banded, Sparse, etc.). A well-known 
collection ofthese routines is LAPACK- LinearAlgebra PACKage, originally written in 
Fortran771. 

We cannot possibly discuss all the special algorithms in the limited space avail- 
able. The best we can do is to present the basic methods of solution, Supplemented 
byafewuseful algorithms for banded and sparse coefficient matrices. 


Notation 


Asystem of algebraic equations has the form 


1 LAPACKis the successor of LINPACK, a 1970s and 80s collection of Fortran subroutines. 
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411XI 十 4i2xXoz 十 十 4ioxn 一 六 
421X1 十 422xo 十 … 十 4 一 D2 


431X1 十 43X2 十 … .十 430 一 03 (六 下 


Anp1X1 旧 避 Ap2X2 上 AmpCz 一 忆 


where the coeffcients 4ij and the constants Dj are known, and ;% Iepresent the un- 
knowns. mn matrix notation the equations are written as 


4 4 … 4 X1 忆 
421 4 … 42n X2 D2 
二 : (2.2) 
4 412 和 47 1 及 
oD Simply 
Ax 一 b (2.3) 


Aparticularly useful representation ofthe equations for computational purposes 
is the CUS7e1ted coe 太 ciet 17011772 obtained by adjoining the constant Vector b to 
the coefficient matrix Ain the following fashion: 


4 4 … 和 4 | 亡 
4 4 …， 4 |pD2 

站 Le 人 .4) 
.41 .42 全 Li 忆 


Uniqueness of Solution 


Asystem of linear equations in 7 unknowns has a unique solution, provided that 
the determinant ofthe coefhicient matrix is 10181728VLC7P ie., 让 |AI 夭 0. The rows and 
columns ofanonsingular matrix are 1772ed1j zcdepe1zdeztin the sensethatnoITow (oOT 
colummn) is alinear combination of other rows (or columns). 

Ifthe coefticientmatrix is s7728127 the equations mayhave an infinite number of 
Solutions, or no solutions at al depending on the constant vector. As an illustratiom， 
take the equations 


2X 十 = 三 3 4X 十 2 一 6 


Since the second equation can be obtained by multiplying the first equation by two， 
any combination of x and y that Satisfies the first equation is also a solution of the 
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Second equation. The number of such combinations is infinite. On the other hand， 
the equations 


27 十 三 3 4X 十 2 三 0 


have no solution because the second equation, being equivalent to 2x 十] = 0, con- 
tradicts the firstone. Therefore, anysolution thatsatisfies oneequation cannot satisfy 
the other one. 


I 响 -Conditioning 


An obvious question is: what happens when the coefficient matrix is almost singular; 
ie 这 |IAlis verysmall? In orderto determinewhetherthe determinantofthe coefficient 
matrixis “small”" weneedareferenceagainstwhich the determinantcanbemeasured. 
This reference is called the 7zo77a2 of the matrix, denoted by IIAll. We can then say that 
the determinantis small 让 


IAl << Al 
Several norms of amatrixz have been defined in existing literature, Such as 


玫 玉 
> >》 吉 


志 1 疡 1 


Al = 





IAl = max 》 |4j| (2.5a) 
产 1 


1<i<7 


Atformal measure of conditioning is the 102C17rzx co1di1o7 2U12Dem defined as 
cond(A) = IIAl |A24 (2.5b) 


Ifthisnumberis closeto unity the matrixis well-conditioned. The condition number 
increases with the degree of il-conditioning, reaching infinity for a singular matrix. 
Notethatthe conditionnumberisnotunique,butdepends onthechoice ofthematrix 
norm. Unfortunately the condition number is exzpensive to compute for large matri- 
ces.In most cases itis sufficientto gauge conditioning by comparingthe determinant 
with the magnitudes ofthe elements in the matrix. 

Iftheequations are 记 -conditioned small changes in the coefficientmatrix result 
in large changes in the solution. As an illustratiomn, consider the equations 


2X 十 三 3 2X 十 1.0017y =0 


that have the solution X = 1501.5, y = -3000. Since |IAl = 2(1.001) 一 2() = 0.002 is 
much smaller than the coefficients, the equations are 说 -conditioned. The effect of 
训 -conditioning can be verified by changing the second equation to 2x 十 1.002y = 0 
and re-Solving the equations. The result is X = 751.5, y = 一 1500. Note that a 0.1 兄 
change in the coefhicient ofy produced a 100% change in the solution. 
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Numerical solutions ofil-conditionedequations arenottobetrusted.Thereason 
is that the inevitable roundoff errors duringthe solution process are equivalent to in- 
troducingsmallchangesintothecoeffticientmatrix.Thisinturnintroduceslarge errors 
into the solution, the magnitude ofwhich depends on the severity ofil-conditioning. 
In suspect cases the determinant ofthe coefthicientmatrixshouldbe computedsothat 
the degree ofil-conditioning can be estimated. This can be done during or after the 
Solution with only a small computational effort. 


Linear 9ystems 


Lineamn algebraic equations occur in almost all branches of numerical analysis. But 
their most visible application in engineering is in the analysis of linear Systems (any 
System whose response is proportional to the input is deemed to be linean. Linear 
Systemas include structures, elastic solids, heatflow, seepage offluids, electromagnetic 
fields and electric circuits; ie., most topics taught in an engineering curriculum. 
Ithe system is discrete, such as a truss or an electric circuit then its analysis 
leads directly to linear algebraic equations. In the case of a statically determinate 
truss, for exzample, the equations arise when the equilibrium conditions of the joints 


are wiitten down. The unknowns xl, xz,...，,xXn IepIesent the forces in the members 
andthesupportreactions, andthe constants Di, p2,... ,Draretheprescribed external 
loads. 


The behavior ofcontinuous Systems is described by differential equations, rather 
than algebraic equations. HoweveD because numerical analysis can deal only with 
discrete variables, it is first necessary to appIroximate a differential equation with a 
System of algebraic equations. The well-known finite difference, finite element and 
boundary element methods of analysis work in this manner. They use different ap- 
pIoximations to achievethe “discretization ”butin each casethefinaltaskis the same: 
Solve a System (often a very large System)] of linear algebraic equations，. 

In Summary the modeling oflinear Systems invariably gives rise to equations of 
the form Ax = b, where b is the input and X represents the response of the System 
The coefficient matrix A,， which reflects the characteristics of the System, is inde- 
pendent of the input. In other words, 让 the input is changed, the equations have to 
be solved again with a different b, but the same A. Therefore, it is desirable to have 
an equation-solving algorithm that can handle any number of constant vectors with 
minimal computational effort, 


Methods of Solution 


There are two classes of methods for solving systems of linear algebraic equations: 
directand iterative methods. The common characteristic ofdiz7ect7aetpodsisthatthey 
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transform the original equations into eqgiZCiet eqgUatio1s (equations that have the 
Same Solution) that can be solved more easily. The transformation is carried out by 
applyingthe three operations listed below. These so-called ele117e11C17y ope1atio1s do 
notchange the solution, buttheymay affectthe determinant ofthe coefthicient matr 这 
as indicated in parentheses. 


。 Exchanging two equations (changes sign of |Al). 

。 Multiplying an equation by a nonzero constant (multiplies |Al by the Same 
constant). 

。 Multiplying an equation by anonzero constant and then subtracting it from an- 
other equation (leaves |Al unchanged). 


Iterative, oOT 172Gi7ect 11etpods, start with a guess of the solution x, and then re- 
peatedly refine the solution until a certain convergence criterion is reached. Iterative 
methods are generally less efficient than their direct counterparts due to the large 
number of iterations required. But they do have significant computational advan- 
tages 这 the coefficient matrix is very large and sparsely populated (most coefficients 
are ZerI0). 


Overview of Direct Methods 


Table2.ljliststhreepopular directmethods, each ofwhich useselementaryoperations 
to produce its own final form of easy-to-solve equations. 

















Method Initial form | Final form 
Gauss elimination Ax=b UX=c 
LU decomposition Ax=b LUX 一 b 
Gauss-Jordan elimination Ax=b 区 一 <C 

















Table 2.1 


Inthe abovetable Urepresents an uppertriangular matrix, Lis alowertriangular 
matrix and I denotes the identity matrix. A_ square matrix is called 太 rzC728xLC7r 证 让 
contains only zero elements on one side ofthe leading diagonal. Thus a3 x 3 upper 
triangular matrix has the form 


Li Un nas 
U=| 0 UL rs 
0 0 LU733 
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anda3 x3lowertriangular matrix appears as 


LI 0 0 
工 =| ZL21 ZLzz 0 
ZL3l1 ZL32 33 


Triangular matrices play an important role in linear algebra, since they simplify 
many computations. For example, consider the equations LX = C, OT 


ZL11X1 = Cl 
了 21X1 十 也 22X2 一 C2 


了 31X1 十 了 32X2 十 33X3 一 C3 


下 we solve the equations forward, starting with the first equation, the computations 
are Very easy Since each equation would contain only one unknown at a time. The 
Solution would thus proceed as follows: 


X1 三 CL/Lll 


X2 一 (C2 一 工 21X1)]/ 工 22 


X3 一 (C3 一 世 31X1 一 了 32X2]/ 了 33 


Thisprocedureisknown asjorrwa1dsxpstHtuton.Inasimilarway Ux = c,encountered 
in Gauss elimination, can easily be Solved by pack sps1itULo1, which starts with the 
lastequation and proceeds backward through the equations. 

The equations LUx = b, which are associated with LU decomposition, can also 
be solved quickly 让 we replace them with two sets of equivalent equations: Ly = b 
andUX 王 记 NowLy=b can be solvedforyby forward substitution, followed by the 
solution ofUx =yby means ofback substitution . 

The equations 区 = c， which are produced by Gauss-Jordan elimination，are 
equivalenttox= c (recall the identity I = 区 ,so that cis already the Solution. 


EXAMPLE 2.1 
Determine whether the following matrix is singular: 


2.1. = 一 册 .6 工 .1 
及 二 32 4.7 一 0.8 
3.1 一 6.5 4.1 
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2.2 


solution Laplaces development (SeeAppendixA2) ofthe determinantaboutthe first 
IOwW ofAyields 


4.7 一 0.8 
一 6.5 4.1 


3.2 一 0.8 
3.1 4.1 


3.2 4.7 


Al = 2.1 
3.1 -6.5 


十 0.6 十 1.1 




















一 2.1(14.07) 十 0.6(15.60) 十 1.1(--35.37) = 0 


Since the determinant is zero, the matrix is singular. It can be verified that the singu- 
larity is due to the following row dependency: (IIow3) = (3 x ITow1) -- (Tow2). 


EXAMPLE 2.2 
Solve the equations Ax = b, where 
8 一 6 2 28 
A=|-4 11 -7 b 一 | -40 
4 一 7 6 33 


knowingthattheLU decomposition ofthe coefficientmatrixis (Vou should verify this) 


A=LU=| 一 1 2 0 0 4 一 3 
1 = 了 0 0 2 


solution We first solve the equations Ly = b by forward substitution: 


2]1 二 28 妨 =28/2 = 14 
-J1 二 272=-40 和 =(40+J)/2= (-40 上 +14)12 = 一 13 
嫉 一 包 十 Ja=33 Js=33-Ji+yj2=33-14-13=6 





The solution xis then obtained from Ux = ybyback substitution: 


2X3 一 J3 X3 一 Ja/2=6/2=3 
4X2 一 3X3 一 Ja X2 一 (JJ2 十 3X3)/4 一 [一 13 十 3(3)] /4 = 一 | 
4X1 一 3X2 十 X3s 一 1 X1 三 (1 十 3X2 一 XY3)/4= [14 十 3(-J 一 3]/4=2 


Hence the solution isx= [2 -1 3]7 


Gauss Elimination Method 
Introduction 


Gauss elimination is the most familiar method for solving simultaneous equations. II 
consists of two parts: the elimination phase and the solution phase. As indicated in 
Table 2.1, thefunction ofthe elimination phase is to transform the equations into the 
form Ux = c. The equations are then solvedbyback substitution. In orderto ilustrate 
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the procedure, let us solve the equations 


4X1 一 2X2 十 X3 一 1 (al 
一 2X1 十 4X2 一 2X3 一 一 16 (b) 
X1 一 2X2? 十 4X3 一 17 (C) 


E/1mination phnase The elimination phase utilizes only one of the elementary op- 
erations listed in Table 2.1 一 multiplying one equation (say equation j ) by a constant 
和 andsubtractingitfrom anotherequation (equation 站 .The symbolic representation 
ofthis operation is 


Eq. 0 < Eq. 0D) -和 x Eq.(J) (2.6) 


The equation being subtracted namely Eq. (J),is called the Pivof eqatzo7. 
We start the elimination by taking Eq. (a) to be the pivot equation and choosing 
the multipliers 和 so as to eliminate Xl from Eqs. (b) and (c): 


Eq. (b) 和 二 Eq. (b) 一 (- 0.5) x Eq. (a) 
Edqd. (c) 和 Eq. (c) -- 0.25 x Eq. (a) 


After this transformation, the equations become 


4X1 一 2X2 十 X3 一 11 (a) 
3xX2 一 1.5X3 一 一 10.5 (b) 
一 1.5X2> 十 3.75X3 三 1]14.25 (C) 


This completes the firstpass. Now we pick (b) as the pivot equation and eliminate X2 
from (c): 


Eq. (c) 和 Eq. (c) -- (-- 0.5) x Eq. (b) 


Which yieldqs the equations 


4X1 一 2X2 十 XY3 一 1 (a) 
3x2 一 1.5Xa 一 一 10.5 (D) 
3X3 一 9 (C) 


The elimination phase is now complete. The original edquations have been replaced 
byequivalent equations that can be easily solved by back substitution. 

As pointed out before, the augmented coeffGicient matrix is a more convenient 
instrument for performing the computations. Thus the original equations would be 
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Wiitten as 


and the equivalent equations produced by the first and the second passes of Gauss 
elimination would appear as 


4 一 2 1 11.00 
0 沪 一 1.5 | 一 10.50 
0 一 1.5 3.75 14.25 


4 一 2 1 11.0 
W ”二 富山 二 10.5 
0 0 3 9.0 


It is important to note that the elementary Iow operation in Eq. (2.6) leaves 
the determinant of the coefficient matrix unchanged. This is rather fortunate, since 
the determinant of a triangular matrix is very easy to compute 一 it is the product 
of the diagonal elements (you can verify this quite easily). In other words， 


AI=IUJI=CaxLzx :xxUan (2.7) 
Back substitution phase The unknowns can now be computed by back substitu- 


tion in the manner described in the previous article. Solving Eqs. (c, (b) and (a) in 
that orden we get 


X3 一 9/3 三 :3 
xa = (二 10.5 二 1.5xs)/3 = [一 10.5 十 1.5(3)]/3 = 一 2 





Xi = (11+2xz 一 xz3)/4=[l1+2(2) 一 3]/4=1 


Algorithm for Gauss Elimination Method 


EJ11mination phase Let us look at the equations at some instant during the elim- 
ination phase. Assume that the first Erows of A have already been transformed to 
uppertriangular form. Therefore, the current pivot equation is the Kth equation, and 
all the equations below it are still to be transformed. This situation is depicted by the 
augmented coefGcient matrix Shown below. Note that the components of A are not 
the coef6cients of the original equations (except for the first row),， since they have 
been altered by the elimination procedure. The same applies to the components of 
the constant vector b. 


2.2 Gauss Elimination Method 





41 42 4 .45 5 4) 4 | 六 

0 4 4 :4k 4j 4 |D2 

0 0 4 .48 Ah4j 4 | 有 

0 0 0 4x 4j 4 帮 | 一 pivot row 

0 0 0 :4 4 4n| 太 | <Iowbeing 
transformed 

0 0 省 





Letthe ;th rowbeatypicalrowbelowthepivotequation thatis to betransformed， 
meaningthatthe element 4ikis to be eliminated. We can achieve this bymultiplying 
the pivotrow by 人 = 4k/ 4 and subtracting it from the ;th row. The corresponding 
changes in the ith row are 


4ij < 和 人 1 一 和 人 三 乒 K 十 1 .7 (2.8a) 
已 < 太一 入 隐 (2.8b) 


Totransformtheentire coefficientmatrixtouppertriangularform, kandiinEqs.(2.8) 
musthavetheranges 大 = 1,2,...,1 一 1(choosesthepivotrow,i 一 大 十 1 大 十 2... ,7 
(chooses the Iow to be transformed). The algorithm for the elimination phase now 
almost writes itself: 


fomr K = 1:m-1I 
fom 工 = K+1:Dn 
If ACTI,k) "= 0 
ambda = ACTI,K)/ACK,K) ; 
A(I,k+1:n) = ACTI,k+lL:n) - LambdaxA(CK,Kk+1:n) ; 
b(Ci)= bGI) - Lambdax*bCK) ; 
end 
end 


emnd 


In order to avoid unnecessary operations, the above algorithm departs slightly 
from Eqs. (2.8) in the following ways: 


。 HI 4xhappens to be zero, the transformation ofrow iis skipped. 
。 The index j in Eq. (2.8a) starts with K 十 1 rather than 太 . Therefore，Aik is not re- 
placed by zero, but retains its original value. As the solution phase never accesSes 
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the lower triangular portion of the _ coefficient matrix anyway， its contents are 
irrelevant. 


Back substitution phase After Gauss elimination the augmented coefficient ma- 
tr 这 has the form 


41 4 4 …， 4 | 访 

0 42> 423 本 演 全 427 2D2 

|A b] 三 川 | 介 0 4 …， 4 | ps 
0 0 0 55 | 奈 





The lastequation, 4 = Do is Solved first yielding 


1 一 已 [Ar 人 包 :9) 
Consider now the stage of back substitution where xm，XW-1,...，Xkrkl have been 
alreadybeen computed (in that orden, andwe are aboutto determine xx from the /th 


equation 
4 十 AHIXEH 十 十 4 三 必 


The solution is 





用 
1 
您 一 | 克 一 4 ， 天 一 刀 一 17 一 2,...,1 (2.10) 
The corresponding algorithm for back substitution is: 


for K = mn:-1:1 
b(CK) = (Pb(CK) - ACK,K+1:n)xbCKk+1:n))VXACK,K) ; 


end 


国 5aussS 


Thefunction gauss combines theelimination andthebacksubstitution phases.Dur- 
ingback substitution b is overwritten by the solution vector x, So thatb contains the 
Solution upon exit, 


function [xx,dqet] = gauss(A,b) 
% Solves Ax*X = b by Gauss elimination and computes det(A) . 
% USAGE: [X,dqdet] = gauss(A,b) 


If size(b,2) > 1; b= b'; end % b must be column vector 
n = engthCb) ; 


区 一 2.2 Gauss Elimination Method 


for K = :mn-I % ELimination phase 
for 工 = K+1:Dn 
If ACTI,k) "= 0 
Iambda = A(CI,K)/ACK,K) ; 
A(I,k+1:n) = ACTI,k+lL:n) - ambdaxA(CK,Kk+1:n) ; 
b(Ci)= b(GI) - Lambdax*b(CK) ; 


end 
end 
emnd 
If nargout == 2; det = prod(Cdiag(A)); end 
for K = Di:-1:1 工 % Back substitution phase 


b(CKk) = (CbCK) - AGCK,Kk+1:n)x*bCK+1:n)D)VXACK,K) ; 


end 


Multiple Sets of Equations 


As mentioned before, it is frequently necessary to solve the equations Ax = b for 
SeverIal constant vectorSs，Let there be 710 Such constant vectorSs，denoted by 
bl,b>,... ,bnrandletthe corresponding solution vectors be Xl, Xz, ...,Xm. We denote 
multiple sets ofequations byAX = B, where 


X= | X2 .….. 师 | B=|bi b>， .……. 人 | 


arex 71 matrices whose columns consist of solution vectors and constant vectors， 
IeSpectively. 

An economical way to handle such equations during the elimination phase is 
to include all 1 constant vectors in the augmented coefficient matrix, so that they 
are transformed Simultaneously with the coefticient matrix. The solutions are then 
obtainedbyback substitution in theusual manner onevectoratatime.Itwould quite 
easy to make the corresponding changes in gauss. However the LU decomposition 
method, described in the next article, is more versatile in handling multiple constant 
Vectors. 


EXAMPLE 2.3 
Use Gauss elimnination to solve the equations AX = B, where 


6 一 4 1 一 1]14 22 
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solution The augmented coefficient matrix is 


6 一 4 1 | 一 14 22 
一 4 6 一 4 36 一 18 
1 一 4 6 6 7 


The elimination phase consists of the following two passes: 
IOW2 < IOwW2 十 (2/3) x IOwW1L 
IOwW3 < IOwW3- (1/6) x IOwW1L 

6 一 人 1 | 一 14 22 


0 10/3 -10/3 | 80/3 -10/3 
0 -10/3 35/6 | 25/3 10/13 


and 
IOW3 < IOwW3 十 IOwW2 
6 一 4 1 一 14 22 


0 10/3 -10/3 | 80/3 -10/3 
0 0 5/2 | 35 0 


In the solution phase, we first compute xl by back substitution: 











X31 一 9 一 14 
572 
80/3 上 (10/3)X 80/3 + (10/3)14 
X?1 一 一 三 22 
1073 1073 
一 14 十 4X?>1 一 人 X: 一 14 十 4(22) 一 14 
和 二 十 5 31 十 < ) _10 


Thus the first solution vector is 
了 页 
看 二 | 而 1 | =| 10 22 14] 


The second solution vector is computed nextb also using back substitution: 








Xas2 一 (0 
_10/3 上 (10/3)X， -10/3 上 +0 
X2? 一 一 一 由 
1073 1073 
22 十 4X2， 一 XX: 22 十 4(-JH 一 0 
和 一 十 要 32 22 十 ) _3 


Therefore， 


四 2.2 Gauss Elimination Method 


EXAMPLE 2.4 
An7x7Vvandermode matrixAis defined by 


人 一 中 212 
where vis a vector In MAILAB a Vandermode matrix can be generated by the com- 
mand vander(Cv). Use the function gauss to compute the solution ofAx = b, where 
Aisthe6x6Vandermode matrix generated from the vector 


v=|10 12 14 1.6 1.8 20] 


and 
b=|。 104100 1] 


Also evaluate the accuracy of the solution (Vandermode matrices tend to be 记 - 
conditioned). 


solution We used the program shown below. After constructingA andb, the output 
format was changed to Iong so that the solution would be printed to 14 decimal 
places. Here are the ITesults: 


% EXample 2.4 (Gauss elimination) 

A = vander(1:0.2:2); 

b= [010101] 

format ong 

[X,dqet] = gauss(A,b) 

X = 
工 .0e+004 
0.04166666666701 
-0.31250000000246 
0.92500000000697 
-1 工 .35000000000972 
0.97093333334002 
-0.27510000000181 


det = 
-1.132462079991823e-006 


As the determinant is quite small relative to the elements ofA (you may want to 
printAto verify this), we exzpect detectable roundoff error. Inspection ofxleads us to 
Suspect that the exact Solution is 


了 
x= | 125013 一 3125 9250 一 13500 29128/3 -2751 | 


in which case the numerical solution would be accurate to 9 decimal places. 
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2.3 


Another way to gauge the accuracy ofthe solution is to computeAx and compare 
the result to b: 


>> Ar#* 往 

ans = 
-0.00000000000091 
0.99999999999909 
-0.00000000000819 
0.99999999998272 
-0.00000000005366 
0.99999999994998 


The result seems to confirm our previous conclusion, 


LU Decomposition Methods 
Introduction 


Itis possible to showthatanysquare matrixA can beexpressedasaproduct ofalower 
triangular matrixLand an Upper triangular matrix U: 


A=LU (2.11) 


The process of computingL and U for a given Ais known as LU deco2pos 太 om oOT 
LU Joctorizatio1. LU decomposition is not unique (the combinations ofL and U for 
a priescribed A are endless), unless certain constraints are placed on L or U. These 
constraints distinguish one type of decomposition from another. Three commonly 
used decompositions are listed in Table 2.2. 


























Name Constraints 

Doolittles decomposition | 二 一 1， 1 一 1,2,...，,7 
Crouts decomposition (万 二 1， 一 1,2,... ,7 
Choleskis decomposition | 工 = UT7 





Table 2.2 


After decomposing A, it is easy to Solve the equations Ax = b, as pointed out in 
Art. 2.1. We first rewrite the equations as LUX = b. Upon using the notation UxX 一 交 
the equations become 


所 
1 
可 
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which can be solved for yby forward substitution. Then 
UX 王 Y 


will yieldxby the back substitution pIocesSs. 

The advantage of LU decomposition over the Gauss elimination method is that 
once Ais decomposed, we can solve Ax = b for as many constant vectors b as we 
please. The cost of each additional solution is relatively small since the forward and 
back substitution operations are much less time consuming than the decomposition 
DPIocesSS， 


Doolittle's Decomposition Method 


Decomposition phnase Doolittles decomposition is closely related to Gauss elim- 
ination. In order to jllustrate the relationship, considera3 x 3 matrixA and assume 
that there exist triangular matrices 


1 0 0 Da Us Us 
= 一 | 1 0 U=| 0 UL Lps 
了 31 了 32 1 0 0 La3 


Such thatA =LU. After completing the multiplication on the Tright hand side, we get 


CA Cn Us 
A=| UL UazL2l 十 UL LA3sZL21 十 LP3 (2.12) 
LiZL3sl Una27La3sl 二 LpoLas LUn3sL3sl 十 LpP3sLasz 十 L6s 


Let us now apply Gauss elimination to Eq. (2.12). The first pass of the elimina- 
tion procedure consists of choosing the first row as the pivot row and applying the 
elementary operations 


IOwW2 < IOow2 一 7L2?1 xiowl(eliminates 421) 
IOwW3 < IOw3 一 ZL3sl xiriowl(eliminates 43)) 
The result is 


[1 [> Cs 
A' 一 0 LP> LP3 
0 Lp21L3z LasLaz 十 Lps 


In the next pass we take the second row as the pivotrow and utilize the operation 


IOw3 < IOwW3 一 La xirow2(eliminates 43?) 
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ending up with 
1 Un ns 
A“=-U=| 0 UL， Us 
0 0 Lp3 


The foregoing illustration reveals two important features ofDoolittles decompo- 
Sition: 


。 The matrix U is identical to the upper triangular matrix that results from Gauss 
elimination. 

。 The off-diagonal elements of L are the pivot equation multipliers used during 
Gauss elimination; thatis, Zi is the multiplier that eliminated Ai 


It is usual practice to store the multipliers in the lower triangular portion of the 
coefficient matrix replacingthe coefficients astheyareeliminated (Zireplacing 4 门 . 
The diagonal elements ofL do not have to be stored, Since it is understood that each 
of them is unity The final form ofthe coeffhicient matrixz would thus be the following 
Imixture ofL and UL: 


1 Un ns 
[LA\U=| ZL CC ps (2.13) 
ZL31 Za3s> (Lps 


The algorithm for Doolittles decomposition is thus identical to the Gauss elim- 
ination procedure in gauss, exceptthat each multiplier 和 is now stored in the lower 
triangular portion of A. 


国 LUdec 


In this version of LU decomposition the original A is destroyed and replaced by its 
decomposed form [INU]. 


function A = LUdec(CA) 
% LU decomposition of matrix Ai; Teturns A = [LNU] . 
% USAGE: A = LUdec(A) 


nn = Size(A,1) ; 
fozr K = 1 工 :mn-I 
fozr 寺 = K+1L:Dn 
If ACTI,k) "= 0.0 
Lambda = A(CI,K)/ACK,K) ; 
A(I,Kk+1:n) = ACTI,k+l:n) - ampbdaxA(CK,Kk+1:n) ; 


2.3 LU Decomposition Methods 


A(CI,k) = Lambda; 
emnd 
emnd 


emnd 


Solution phase Consider now the procedure for solving Ly = b by forward substi- 
tution. The scalar form ofthe equations is (recall that 二 i = ]) 


J1=Di 
ZL21J1 十 ]J2 = 六 2 


并 ELJ1L 十 工 t2]y2 十 …: 十 工人 1IYR 1 十 其 三 区 


Solving the kth equation for JK yields 


有 一 1 
其 = 大 一 》 5] 大 = 2,3, .六 (2.14) 
j=1 


Letting y overwrite b, we obtain the forward substitution algorithm: 


失 加 一 攻 过 22 而 
YCk)= b(CK) - ACK,1:K-1)*yC1:Kk-1) ; 


end 


The back substitution phase for solving UX = yis identical to that used in the 
Gauss elimination method. 


国 工 Uso] 


This function catrries out the solution phase (forward and back substitutions). It is 
assumed that the original coefcient matrixz has been decomposed, so that the input 
i8A= [LN\U].Thecontents ofb arereplacedbyyduringforwardsubstitution.Similarly, 
back substitution overwriites y with the solution X. 


function X = LUsolL(A,b) 

% Solves LxUx*b = X，WwWhere A contains both L and TU 
% that is，A has the form [LNXU] . 

% USAGE: X = LUsol(A,b) 
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If size(b,2) > 1; b=b'; end 
n = lengthCb) ; 
for K = 23:n 
bCKk) = bCK) - AGCK,1:K-1)x*b(C1L:K-1) ; 
end 
for KkK = Dn:-1: 工 
b(k) = (PbCk) - ACK,Kk+1:n)*bCk+1l:n))VXACGKK) 


end 


Choleski'xs Decomposition 


Choleskis decomposition A = LL7 has two limitations: 


。 Since the matrix productLL7 is symmetric, Choleskis decomposition requires A 
to be SJ7111e177c. 

。 The decomposition process involves taking square roots of certain combinations 
of the elements ofA. It can be shown that square Ioots of negative numbers can 
be avoided only 计 Ais posive dejizzzte. 


Although the number of long operations in all the decomposition methods is 
about the same，Choleskis decomposition is not a particularly popular means of 
solving Simultaneous equations, mainly due to the restrictions listed above. We study 
itherebecauseitis invaluable in certain otherapplications (e.g.,inthetransformation 
of eigenvalue problems). 

Let us start bylooking at Choleskis decomposition 


A= 工 [7 (2.15) 
ofa3 x3matrix: 
4 4 43 ZI 0 0 ZL11 ZL21 Za3sl 
421 4 4as|1=|L2 L 0 0 7L22 Za32 
431 43 433 ZL3l1 ZL32 了 33 0 0 La33 


After completing the matrix multiplication on the right hand side, we get 


4 4 43 了 ZL11721 ZL117a31l 
4 4 4 |=| Dr ZL 十 722 工 ?1ZL3l 十 世 ?2232 (2.16) 
431 43 433 ZL117L31 ZL2173l 十 227L32 工 3 十 工 3 十 工 3 


Notethattheright-hand-sidematrixis symmetric,aspointedoutbefore.Equatingthe 
matricesA and LL7 element-by-elementb we obtain six equations (due to symmetry 
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only lower or Upper triangular elements have to be considered) in the six unknown 
components ofL. By solving these equations in a certain order it is possible to have 
only one unknown in each equation. 

Consider the lower triangular portion of each matrix in Eq. (2.16) (the upper 
triangular portion would do as wel). By equating the elements in the first columm， 
starting with the first row and proceeding downward, we can compute Li, ZL2l and 
La3l in that order: 


4 = 了 TI1 ZL1 =V4il 
4 = Lil7Lai ZL21 = 421/L1l 
431 = LI117L3l ZL3l = 4351/L1l 
The second column, starting with second row, yields Zaz> and 工 3>: 
42z = 72 十 ZL22 La2z = V42z 一 2 
4az = 了 21731 十 了 22732 了 32 = (4a2 一 ZL21731)/ 了 22 
Finally the third column, third row gives Us 工 33: 
4 = 7L3 十 ZL3 十 工 3 Las = V 433 一 7L3 一 L3 


We can now extrapolate the results for an 1 x matrix. We observe that a typical 
element in the lower triangular portion ofLL7 is ofthe form 


了 
(LE 六 = 十 工 2 工 2 十 十 IE >》 TELj > 
肥 1 
Equating this term to the corresponding element ofAYyields 
了 
人 =》 TELEjp 一 着 1 及 了 一 1 2 天 (2.17) 


/一 1 


The range of indices shown limits the elements to the lower triangular part. For the 
first column (7 = 1] we obtain from Eq. (2.17) 


Z1 =V4il 7 = /DPI， 一 2,3, .7 (2.18) 


Proceeding to other columns, we observe that the unknown in Eq. (2.17) is Zi (the 
other elements ofL appearing in the equation have already been computed). Taking 
the term containing Zi outside the summation in Eq. (2.17), we obtain 
| 
全 = TEL 天 十 了 
肛 1 
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If = 7 (adiagonalterm)j , the solution is 


5 (2.19) 





FEoranondiagonal term we get 


节 
攻 = (和 -天 同人 咖 三 3 三 心 二 2 (2.20) 
KE 


国 Cholesk]I 


Note that in Eqs. (2.19) and (2.20) 4ij appears only in the formula for 了 六 Therefore， 
once Zi has been computed, 4ij ii no longer needed. This makes it possible to write 
the elements of L over the lower triangular portion of A as they are computed. The 
elements above the principal diagonal ofA will remain untouched. Atthe conclusion 
ofdecompositionLis extracted with the MAILAB commandtril(A).IHanegative 帮 1 
is encountered during decomposition, an error message is printed and the pIogram 
is terminated. 


function 工 = choleskICA) 
% Computes L :in Choleski's decomposition A = LIL "， 
% USAGE : 工 = choleski(CA) 


nn = Size(A,1); 
皇 @ 下 :可 .过 工 才 这 
temp = A(Jj,Jj) - dot(CA(GJ,1:Jj-1),A(GJ,1:J 了 -1) ) ; 
If tempb < 0.0 
error( Matrix Is not positive qdqefinite ") 
emnd 
A(J,Jj) = sqrtCtemp) ; 
for 工 = J+1:nm 
ACTI,J)=(AGEI,J) - dot(A(GI,I:J-1),AGJ,1:J-1)77)VACGJ ,JJ7 
emnd 
emnd 
王 “ 营 : 瑟 王 王 二 ( 坟 >) 


We could also write the algorithm for forward and back substitutions that are 
necessary in the solution of Ax = b. But since Choleskis decomposition has no ad- 
vantages over Doolittles decomposition in the solution of simultaneous equations， 
we will skip that part. 


区 玉 2.3 LU Decomposition Methods 


EXAMPLE 2.5 
Use Doolittes decomposition method to solve the equations Ax = b, where 
1 和 工 7 
A=|1 6 -=! bs | 13 
2 -1 2 5 


solution We first decompose A by Gauss elimination. The first pass consists of the 
elementary Operations 


IOw2 < IOW2 一 1x rowl(eliminates 421) 
IOoOw3 < 二 IOW3 一 2x rowl(eliminates 4531) 


StoringthemultipliersZ2zl = 1and7sl=2inplaceoftheeliminatedterms,we obtain 


1 4 1 
A =|1 沁 运 忆 
二 9 0 


The second pass of Gauss elimination uses the operation 
IOwW3 < IOwW3-(-4.5) x Iow2 (eliminates 43?) 


Storing the multiplier 了 La = 一 4.5 in place of 4a>, we get 


1 4 1 
A“=[INUI=|1 2 = 双 
2 一 4.5 一 9 


The decomposition is now complete, with 


工 0 0 1 4 1 
工 王 | 1 1 0 末 三 小 0 22 三 2 
2 一 4.5 1 0 9 9 


Solution of Ly = b by forward substitution comes next. The augmented coe 替 - 
cient form of the equations is 


1 0 017 
加害 芭 1 1 0|1313 
入 4 汪 | 5 


The solution is 


J 三 7 





Ja =13 贡 三 13 7 一 6 


Ja=5- 2 和 +45j2=5 一 2(07) 十 45(6) = 18 
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Finally the equations UX = 又 OT 





1 4 亚 小 弃 
[uly|=j。 > -2| 6 
0 0 -9|118 
are Solved by back substitution. This yields 
18 
X3 一 忆 汪 一 一 2 
6 十 2xa “6 十 2( 一 2) 
2 一 过 兰 业 
2 允 





X1 一 你 4X2 X3 一 过 4(]) ( 力 j 兰 : 和 


EXAMPLE 2.6 
Compute Choleskis decomposition of the matrix 


4 一 2 2 
A=| 一 2 2 一 4 
2 -4 11 


solution First we note that A is symmetric. Therefore, Choleskis decomposition is 
applicable, provided that the matrix is also positive definite. An a Prioritest for posi- 
tive definiteness is not needed, since the decomposition algorithm contains its own 
test: 让 the square root ofa negative number is encountered, the matrix is not positive 
definite and the decomposition fails. 

Substituting the given matrix forAin Eq. (2.16), we obtain 


4 -2 2 半生 ZI11721 ZI11Z31 
一 2 2 一 4|= 三 了 11721 了 5 十 25 了 21 世 31 十 了 22 了 32 
2 = 示 “ 琳 LIi1L31 217L3l 十 ZL227L3? 工 3 十 并 3 十 工 3 


Equating the elements in the lower (or upper) triangular portions yields 


TI =V4=2 





二 二 2 人 条 莹 二 2 功 2 ET 
元 时 全 2 二 区 人 三 


TI2=V2-7=vV2-12=1 


-4 一 ZL2i7al -4 一 (DO) 
ix 王 1 加 





3 





了 32 一 








1ss=VlI-1I -1 =V1ILI-(2 一 (-3)2=1 


加 加 2.3 LU Decomposition Methods 


Therefore， 
2 0 0 
正三 :| 三 1 1 
1 -3 1 


The result can easily be veriftied byperforming the multiplication LL7 


EXAMPLE 2.7 
SolveAX = B with Doolittes decomposition and compute |Al, where 


3 二 | 4 6 一 4 
A= | 一 2 0 9 B 王 |3 邹 
7 2 汪 2 了 5 


solution Ithe program belowthe coefficientmatrixAis firstdecomposedby calling 
LUdec. Then LUsol is usedto compute the solution one vector at a time. 


% EXxample 2.7 (Doolittle's decomposition) 
A= [3 -14; -205;) 7 2 -2]); 
B= [6 -4;) 32; 7 -5]; 
A = LUdec(CA) ; 
det = prod(Cdiag(A)D) 
O 玉 工 三 工 2SEZG(B ,27 
X(C:,I) = LUsolL(CA,B(C:,I)) ; 


Here are the results: 


>> det = 
=7Z7 

X = 
工 .0000 -1 工 .0000 
工 .0000 1.0000 


工 .0000 0.0000 


EXAMPLE 2.8 
Testthe function choleski by decomposing 


1.44 -0.36 5.52 0.00 
一 0.36 ”10.33 一 7.78 0.00 
5.52 一 7.78 28.40 ”9.00 
0.00 0.00 9.00 61.00 
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solution 
% EXample 2.8 (Choleski dqecomposition) 
A= [1.44 -0.36 5.52 0.00; 
-0.36 10.33 -7.78 0.00; 
5.52 -7.78 28.40 9.00; 
0.00 0.00 9.00 61.00]; 
工 = choleskI(CA) 
Check = Lx*L” % Verify the TeSsult 


>> 工 = 
1 工 .2000 0 0 0 
-0.3000 3.2000 0 0 
4.6000 -2.0000 工 .8000 0 
0 0 0000 6.0000 

Check = 
工 .4400 -0.3600 575200 0 
-0.3600 10.3300 -7.7800 0 
555200 -7.7800 28 .4000 9.0000 
0 0 9.0000 61.0000 


PROBLEM SET 2.1 





1. By evaluating the determinant classify the following matrices as Singular 训 - 
conditioned or well-conditioned. 


1 2 3 2.11 一 080 1.72 
(aj A=|2 3 4 (bj) A=| 一 1.84 3.03 1.29 
3 4 5 一 1.57 5.25 4.30 


2 二] 0 4 3 = 
(Cc) A=| 一 1 2 .三 1 (IJ A=|7 一 2 3 
0 = 三 1 2 5 一 18 13 


1 0 0 1 2 4 
(aj] L=|1 1 0 U=|0 3 21 
1 5/3 1 0 0 0 


M 
2 
记 
| 
2 
王 


(b) 工 =| 一 ! 1 0 U=|0 1 一 3 


蕊 于 2.3 LU Decomposition Methods 


3.Utilize the results ofLU decomposition 
1 0 0 2 二 3 一 荆 
A=LU=|3/2 1 0|io 13/2 -7/2 
1/2 11/13 1||0 0 32/13 
to solve Ax = b, whereb7 = |1 = 2|. 


4.， Use Gauss elimination to solve the equations Ax = b, where 


忆 。 二 3 一 让 3 
A=|3 和 一 9 b = | -9 
2 4 一 | 一 5 


2 0 一 1 0 1 0 

汪汪 0 1 2 0 B 二 0 0 

一 2 0 0 1 

0 0 1 一 2 0 0 

6. Solve the equations Ax = b by Gauss elimination, where 

0 0 2 1 2 1 

0 1 0 2 一 1 1 
A=|1 2 0 一 2 0 b=| -4 
0 0 0 一 1 1 三 2 

0 1 一 1 1 一 1 = 


1 天 Teorder the equations before solving. 


7. FindLand U sothat 


4 -1 0 
0 -1 4 


using (al Doolittles decomposition; (b) Choleskis decomposition. 


8. Use Doolittles decomposition method to solve Ax = b, where 


3 6 一 4 一 3 
A== 9 ”一 8 24 b == 65 
一 12 24 一 26 一 42 


9. Solve the equations Ax = b by Doolittles decomposition method, where 


2.34 “一 4.10 1.78 0.02 
A= | -1.98 3.47 ”一 2.22 b= | -0.73 
2.36 一 15.17 6.18 一 6.63 
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10. Solve the equations AX = B by Doolittles decomposition method where 


4 一 3 6 1 0 
A== 8 一 3 10 B=|0 1 
-4 12 一 10 0 


11. Solve the equations Ax = b by Choleskis decomposition method, where 


1 LI 
二 王 | 外 工 2 又 bp=| 3/2 
1 学 .3 3 
12. Solve the equations 
4 -2 一 3 X1 1.1 
1]2 4 -10|1|xz |= 0 
-16 28 18 X3 一 2.3 


by Doolittles decomposition method. 


13. DetermineLthat results from Choleskis decomposition ofthe diagonal matri 这 


14. 国 Modify the function gauss sothatit will work with 1712constant Vectors. Testthe 
prirogram by solving AX = B, where 


入 二 0 1 0 0 
A= | 一 !1 汪 -一 B=|0 1 0 
0 = 1 0 0 1 


15， 国 A well-known example of an 计 -conditioned matrix is the 瓦 71De7t72CG1T7X 


1 1/2 1/3 
1/2 1/3 1/4 
A=|1/3 1/4 1/5 


Write a program that Specializes in solving the equations Ax = b by Doolittles 
decomposition method whereAis the Hilbert matrix of arbitrary size7 xm and 


隐 
慷 一 汉 ij 
请 1 


芍 2.4 Symmetric and Banded Coefficient Matrices 


2.4 


16. 


17. 


18. 


]9: 


20. 


The program should have no input apart from 7. By running the program, de- 
termine the largest 7 for which the solution is within 6 signifcant figures of the 
exact Solution 


| 到 | 


(the results depend on the software and the hardware used). 


国 Write a function for the solution phase of Choleskis decomposition method. 
Test the function by solving the equations Ax = b, where 


4 一 2 2 6 
A= | -2 2 一 4 b = | -10 
2 一 4 11 27 


Use the function choleski forthe decomposition phase. 


国 Determine the coef6cients of the polynomial y = Co 二 CiX 十 02X2 十 GaxX3 that 
passes through the points (0, 10), (1, 35), (3, 31) and (4, 2). 


国 Determine the 4th degree polynomial y(x) that passes through the points 
(0, 一 (1 1 (3, 3), (5, 2) and (6, 一 2). 


国 Find the 4th degree polynomial y(x) that passes through the points (0, ])， 
(0.75, 一 0.25) and (1, 1), and has zero curvature at (0, 1) and (1, 1). 


国 Solve the equations Ax = b, where 


3.50 277 一 0.76 1.80 站 31 
A 一 一 1.80 2.68 3.44 一 0.09 b 二 4.23 
0.27 5.07 6.90 1.61 13;85 
1.71 5.45 2.68 了 权 寻 由 .55 


By computing |Al and Ax comment on the accuracy of the solution. 


Symmetric and Banded Coefficient Matrices 


Introduction 


Engineering problems often lead to coefficient matrices that are Spa7se1y PoPpVICted， 
meaning that most elements ofthe matrix are zero. If all the nonzero terms are clus- 
tered about the leading diagonal then the matrix is said to be pa7zded. An example of 
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abanded matrix is 


愉 共 共 忆 己 


写 局 已 网 则 
网 网 写 司 所 


乙己 匡 以 攻 
乙 芭 菇 菇 性 


whereXs denote thenonzero elements that form thepopulatedband (Some ofthese 
elements may be zero). All the elements lying outside the band are zero. The matri 这 
shown abovehas abandwidth ofthree, sincethere are atmostthreenonzero elements 
in each row (or colummn). Such a matrix is called rzdiago7CL. 

Iabanded matrix is decomposed in theformA=LU,bothLandU will retain 
the banded structure of A. For example, 让 we decomposed the matrix shown above， 
we would get 


富 - 王 忆 史 吧 
一 一 
一 
愉 芭 忆 忆 避 
愉 己 己 己 己 
握 
| 
一 是 = 下 下 一 国 
一 芋 一 下 一 
= 一旦 一 
一 
区 网 全 局 瑟 


The banded structure of a coefhicient matrix can be exploited to Save storage and 
computation time. Hthe coefficient matrix is also symmetric further economies are 
possible. mn this article we Show how the methods of solution discussed previously 
can be adapted for banded and symmetric coefficient matrices. 


Tridiagonal Coefficient Matrix 


Consider the solution of Ax = b by Doolittles decomposition, where Ais the 7 x77 
tridiagonal matrix 


0 C2 d e3 


一 


0 0 而 语 这 0 C7=1 0 


2.4 Symmetric and Banded Coefficient Matrices 


As the notation implies, we are storing the nonzero elements ofAin the vectors 


夏 
Cl 了 如 1 
肥 
C2 22 
已 至 d E 。 作 王 
C do e 
7 一 7 一 
0 


The resulting Saving of storage can be signifticant. For exzample, a 100 x 100 tridiag- 
onal matrix, containing 10,000 elements, can be stored in only 99 十 100 十 99 = 298 
locations, which represents a compression ratio of about 33:1. 

We now apply LU decomposition to the coeffticient matrix. We reduce row 上 by 
getting rid of ce_l with the elementary Operation 


IOWK < 二 IOWKK 一 (cl1/d 1 xTow (KE 一 1)，K=2,3,. ,7 
The corresponding change in dk is 
天生 砍 一 (cd 1)ekl (2.2]) 


whereas ek is not affected. In order to finish up with Doolittles decomposition ofthe 
form [LN\U], we store the multiplier 和 = ci/d_iin thelocation previously occupied 
by cpl1: 


cl < CE_1/GK 1 (2.22) 


Thus the decomposition algorithm is 


for K = 2:0 
ambda = CCK-1)XdCKk-I) ; 
d(Ck) = dq(CKk) - Lambdaxe(CK-1) ; 
CCK-1I) = Lambda; 


emnd 


Next we look at the solution phase, ie., the solution of the Ly = b, followed by 
Ux = y. The equations Ly = b can be portrayed by the augmented coefficient matrix 


1 0 0 0 0 | 广 
cl 1 0 0 0 | D2 
0 co 1 0 0 | zs 
辐 [ 册 | 志 0 0 al 0 | 序 
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Note that the original contents of c were destroyed and replaced by the multipliers 
during the decomposition. The solution algorithm fory by forward substitution is 


Y(C1L) = b(CI) 
于 0 下 二 27 证 
YyCk) = bCk) - cCk-1)*yCk-I1) ; 


end 


The augmented coefficient matrix Tepresenting Ux = yis 


有 el 0 .…. 0 0 1 
0 中 ee .…. 0 0 ]2 
0 0 古 … 0 0 ]3 
[uly|= II 
0 0 0 0 el Jzz 一 1 
0 0 0 :…: 0 Gd Jr 





Note again that the contents of d were altered from the original values during the 
decomposition phase (bute was unchanged). The Solution forxis obtained by back 
Substitution using the algorithm 


XCn) = YCn)/dCn) ; 
for K = Dn-1L:-1:1| 

XCK) = (YCK) - e(Ck)*XCKk+1))VXdCK) ; 
end 


国 LUdec3 


The function LUdec3 contains the code for the decomposition phase. The original 
vectors cand d are destroyed and replaced by the vectors of the decomposed matrix. 


function [c,de]l = LUdec3(c,de) 
% LU decomposition of tridiagonal matrix A = [cNdxe]. 
% USAGE: [c,d,e]l = LUdec3(c,de) 


nn = length(Cd) ; 

for K = 2:n 
Jambda = CCK-1L)VXdCK-I1) ; 
dCk) = d(k) - Lambda*e(CK-I1) ; 
CCK-1) = Lambda; 


end 
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国 LUsolL3 


This is the function forthe solution phase. The vectory Overwrites the constant Vector 
b during the forward substitution. Similarly the solution vector X Teplaces y in the 
back substitution process. 


function X = LUsol3(c,d,e,b) 

% Solves Ax*X = b where A = [cNdxe] is the LU 
% _ decomposition of the orliginal tridiagonal A. 
% USAGE: X = LUsol3(c,dq,e,b) 


nn = Length(Cd) ; 
for KkK = 2:0n % EForward SubstiItutIon 
b(Ck) = b(Ck) - cGCk-1)*bCk-1) ; 
emnd 
bCGn) = bn)vdaGCn) ; % Back substitutIion 
for K = Dn-1:-1: 工 
b(Ck) = (Cb(Ck) -eCkD)*bCk+177)VdCK) ; 


end 


Symmetric Coefficient Matrices 


More often than not，coefficient matrices that arise in engineering pIoblems are 
Symmetric as well as banded. Therefore, it is worthwhile to discover Special prop- 
erties of such matrices, and learn howto utilize them in the construction of ef6Gicient 
algorithms. 

Hthe matrixAis symmetric, then the LU decomposition can be presented in the 
form 


A=LU=LDLI (2.23) 


where D is a diagonal matrix. An example is Choleski's decomposition A = LL7 that 
was discussedin theprevious article (in this caseD = D.ForDoolittles decomposition 


we have 
DI 0 0 :0 1] ZL21 ZL3l1 ，…， 工 但 
0 D 0 :0 0 1 1713 .722 


已 
| 
已 
己 
吕 
| 
己 
己 
CD 
局 
己 
己 
一 
sa 
色 


乙 
ae 称 沽 ' 若 
0 
考 


0 0 0 :… 轧 
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Which gives 


D1 DiL2l DILa3sl 万 17 
0 7 > 了 32 D> 了 112 
U=-| 0 0 Das Das1an (2.24) 
0 0 0 了 Di 


Weseethat during decomposition ofasymmetricmatrixz onlyUhasto be stored, since 
DandL can be easily recovered frfom U. Thus Gauss elimination, which results in an 
uppertriangular matrix of the form shown in Eq. (2.24), is sufficient to decompose a 
Symmetric matrix. 

There is an alternative Storage scheme that can be employed during LU decom- 
position. The idea is to arrive at the matri 这 


D1 ZL21 ZL3sl …， 了 
0  Dz La …， 722 

U*=-|0 0 Da … La (2.25) 
0 0 0 了 1 


Here U can be recovered from 1 太 = 忆 工 六 世 turns out that this scheme leads to a 
computationally more ef8Gcient solution phase; therefore, we adopt it for symmetric， 
banded matrices. 


Symmetric Pentadiagonal Coefficient Matrix 


We encounter pentadiagonal (bandwidth = 5) coeffhicient matrices in the solution of 
fourth-order ordinarydifferentialequations byfinite differences.Oftenthesematrices 
are Symmetric, in which casean2x7mmatrixhas the form 





看 e1 万 0 0 0 0 
el 丰 @ 户 0 0 0 
万 C2 C3 6C3 方 0 0 
0 疡 6 丰 e4 户 0 
A=|.，， . . . ， (2.26) 
0 0 磷 4 61-3 有 的 eE1-2 万 > 
0 0 0 万 3 eE1-2 Qi 1 eE1-1 
0 0 0 0 Ja erl 


回 2.4 Symmetric and Banded Coefficient Matrices 


As in the case of tridiagonal matrices, we store the nonzero elements in the three 


VectorTrS 
丰 8 
网 及 
EC2 有 
5 2 
d 2 四 一 下 E 。 
CQ 2 e，， ， 
2 1 万 1 一 2 
去 7 一 1 


Letus nowlookatthe solution ofthe equationsAx = b byDoolittes decomposi- 
tion. The first step is to transform Ato upper triangular form by Gauss elimination. 下 
elimination has progressed to the stage where the kth row has become the pivot rowW, 
we have the following situation: 





GLK eK 及 0 0 0 2 由 
ek Gd ekl | 0 0 
大 ekl dk | er jz 0 
0 大 1 ekH | dk ek 3 











户 
| 
口 | 口 吕 吕 |… 




















The elements ek and 大 belowthe pivotrow are eliminated by the operations 


IOwW ([ 二 1) < 二 IOow (KE 十 ]) 一 (ek/dk) xITOowK 天 
IOW (E 十 2) 和 IOw (KK 十 2) 一 (大 /Gdk) xITOwK 天 


The only terms (other than those being eliminated) that are changed by the above 
operations are 


dp < Girl 一 (ek/dbek 
ekHl < ekHl 一 (er/GH 灰 (2.27al) 
dpa < Gi2 一 (jd 大 





Storage ofthe multipliers in the ppertriangular portion ofthe matrix results in 


eEk < ek/dK 友 < 大 /GLK (2.27b) 
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Atthe conclusion ofthe elimination phasethe matrixhas the form (do not confuse d， 
eandfwith the original contents of A) 


看 如 1 万 0 和 证 0 

0 人 5 户 和 部 0 

0 0 Gd3 人 的 生 让 证 0 

U=| 
0 0 和 0 7 人 eEji 一 1 
0 0 … 0 0 加 
Next comes the solution phase. The equations Ly = b have the augmented coef- 
fcient matri 这 

1 0 0 00 0 | 亡 

el 1 0 0 0 | D> 

万 e2 1 0 0 | Da3 
[ b] 一 | 0 户 CE3 | 0 





0 0 0 万 erl 1| 甸 
Solution by forward substitution yields 
J= 刀 
J2 三 户 一 el (2.28) 


了 从 三 用 一 友 2?]Ja 一 eFIJ TI， 天 一 3, 4 .7 


The equations to be solved byback substitution, namelyUx = 多 havethe augmented 





coe 人 cient matrix 
G Gel Gd 及 0 和 0 J/1 
0 C Ce 人 2 户 Si 0 ]2 
0 0 Gd3 Ce3 0 J]J3 
国 交 二 二 | 
0 0 和 生生 0 志 玫 志 1E1-1 JJ/7m 是 
0 0 :0 00 岂 功 





the solution of which is obtained by back substitution: 
JX1 一 Ja/ci 


J1 一 1 一 Ji-1/G 1 一 CE1-1X7 





侈 三 JK/ 克 一 eketHl 一 Ne， 天 = 天 一 2 有 一 3 (2.29) 
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国 Udqdec5 


Thefunction LUdec3 decomposes asymmetric, pentadiagonal matrixA storedin the 
formA= [Ne\dNe\f]. The original vectors d e and f are destroyed and replaced by 
the vectors of the decomposed matrix. 


function [de,f] = LUdec5(d,e,T) 
% LU decomposition of pentadiagonal matrlix A = [fNeNdNxeNf] . 
% USAGE: [de,f] = LUdec5(d,e,TE) 


nn = Length(Cd) ; 

for K = 1:mn-2 
ambda e(CK)VXdCKk) ; 
dCk+1) = qdqCk+1l1) - Lambdaxe(CK) ; 
e(k+1) = e(CKk+1) - ambdax*f(Ck) ; 
e(K) = ambda; 
ambda = 于 (k)/dCk) ; 
dCk+2) = dq(Ck+2) - lambdax*f(CK) ; 
ECK) = ambda; 


emnd 

ambda = e(Cn-1)/dCn-I) ; 

dCn) = dGCn) - Lambdax*e(Cn-1) ; 
e(n-1) = Lambda; 


国 LUSsSolL5 


LUsol5 is the function for the solution phase. As in LUso13,， the vector y overT- 
Writes the constant vectorb during forward substitution andxXreplacesy during back 
Substitution. 


function X = LUsol5(d,e,f,b) 
% Solves Ax*X = b where A = [fNeNxdxeNf] Is the LU 
% _ decomposition of the orliginal pentadliagonal A. 
% USAGE: X = LUsol5(d,e,f,b) 


nn = Length(Cd) ; 
b(2) = b(C2) - e(C 人 1L)x*b(CL) ; % Forward substitutiIon 
for kK = 3:n 

b(k) = bCKk) - e(Ck-1)*bCKk-1) - 研 (k-2)*b(CK-2) 


end 
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也 (三 DCay7/GGn7 3 % Back substitutIon 
bn-1) = bCn-1)/XdCGn-1) - eGCn-1)xbCn) ; 
for K = Dn-2:-1: 工 

b(k) = bCKkK)VXdCGk) - e(Ck)*b(Ck+1) - 王 (k)*b(Ck+2) ; 


end 
过 三: 旋 5 
EXAMPLE 2.9 
As aresult of Gauss elimination, asSymmetric matrA was transformed to the upper 
triangular form 

4 一 2 1 0 

U- 0 3 -3/2 1 
0 0 3 一 3/2 
0 0 0 35/12 


Determine the original matrix A. 


solution First we findL in the decomposition A = LU. Dividing each row of U by its 
diagonal element yields 


1 一 1/2 1/4 0 

T7 0 1 一 1/2 1y/3 

0 0 1 一 1/2 

0 0 0 1 

Therefore,A =LU becomes 

1 0 0 0 4 一 2 1 0 
及 一 一 1/2 1 0 0 0 3 一 3/2 1 
”| 就 1 1 0|!10 0 3 -3/2 
0 1/3 -1/2 1 0 0 0 35/12 


4 一 2 1 0 


EXAMPLE 2.10 


DetermineL and D that result from Doolittles decomposition A = LDL7 ofthe sym- 
metric matrixX 
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solution We use Gauss elimination, storing the multipliers in the pper triangular 
portion ofA. Atthe completion of elimination, the matrix will have the form of U* in 
Eq. (2.25). 

The terms to be eliminated in the firstpass are 421 and 4sl using the elementary 
operations 


IOW2 < IOW2-- (一 ]1) xTrow1L 
IOW3 < IOW3 一 (1) xIow1 


Storingthe multipliers (--1 and lJ) in the locations occupied by 4l> and 4l13, we get 


3 二 | 才 
下 二 0 2 4 
0 4 7 


The second pass is the operation 
IOw3 < IOwW3 一 2XxIOW2 


which yields after overwriting 42s with the multiplier 2 


3 一 1 1 
A'=[O\DNLIJ=|0 2 2 
0 0 一 1 
Hence 
1 0 0 3 0 0 
工 王 | -1 1 0 D=|0 2 
1 二 下 0 0 一 1 
EXAMPLE 2.11 
Solve Ax = b, where 
6 一 4 1 0 0 X1 3 
一 全 6 一 4 1 X2 0 
1 一 4 6 一 4 1 X3 0 
A-== 一 
0 1 一 4 6 一 4 X9 0 
0 0 1 一 4 7 X10 4 


solution As the coefficient matrix is symmetric and pentadiagonal we utilize the 
functions LUdec5 andLUsol5: 


% Example 2.11 (人 Solution of pentadiagonal eqs.) 
nn= 10; 
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2.3 


6*ones(n,1); dGCn) = 7; 

= -4x*ones(Cn-1,1) ; 

ones(Cn-2,1) ; 

= Zeros(n,1); b(1) = 3; bGCn) = 4; 
[de,f] = LUdec5(d,e, 工 ) ; 

X = LUsol5(d,e,f,b) 


可 二， 全 :各 
中 


The output from the program is 


>> X 三 

“3872 
41955 
.4586 
“2105 
.4850 
-358 
368 
.7820 
.4850 
-8797 


上 由 上 mnDODOJwm mm 


Pivoting 
Introduction 


Sometimes the order in which the equations are presented to the solution algorithm 
has a Significant effect on the results. For example, consider the equations 


2X1 一 X? 一 1 
一 X1 十 2X2 一 X3 一 0 
一 X2 十 X3 一 0 


The corresponding augmented coefficient matrix is 


2 -1 011 
[Alp|= -1 2 _-110 (gl 
0 -1 1|0 


Equations (aj are in the Tight order” in the sense that we would have no trouble 
obtaining the correct Solution Xil = X2 = X3 一 1 by Gauss elimination or LU decom- 
position. Now Suppose that we exchange the first and third equations, So that the 


2.5 Pivoting 


augmented coefficient matrix becomes 


0 _1 110 
[Alp|= -1 2 _1|0 (b) 
2 -1 0l|1 


Sincewedidnotchangetheequations (onlytheirorderwasaltered),thesolution is stil 
X1 一 XY2 = X3 一 1. However Gauss elimination fails immediately due to the presence 
of the zero pivot element (the element 4 1). 

The above example demonstrates that it is Sometimes essential to Ieorder the 
equations during the elimination phase. The reordering, or To Pivotzrz8, is also re- 
quiredifthepivotelementis notzero,butverysmallin comparison to otherelements 
in the pivotITrow as demonstrated by the following set of equations: 


ET 下 | 省 
[Alp| = -1 2 _1|10 人) 
2 -1 0l|1 


These equations are the same as Eqs. (b), exceptthatthe small number es replaces the 
Zero element 4ll in Eq. (b). Therefore, 让 welets 一 0,the solutions ofEqs. (b) and (c) 
Should become identical. After the first phase of Gauss elimination, the augmented 
coefficient matrix becomes 


已 


Because the computer works with a fixed word length, al numbers are rounded o 妊 
to a finite number of significant fgures. Is is very small then 1/s is huge, and an 
element such as 2 一 l/s is rounded to -1/s. Therefore, for sufficiently small s, the 
Eqs. (d) are actually stored as 


也 


Becausethe secondandthird equations obviously contradict each other the solution 
process fails again. This problem would not arise 证 the first and second, or the first 
and the third, equations were interchanged in Eqs. (c) before the elimination. 

The last exzample iustrates the extreme case where s was So Small that roundo 娃 
erIIors resulted in total failure of the solution. I 太 we were to make s Somewhat bigger 
So that the solution would not “bomb” any more, the roundoff errors might still be 
large enough to render the solution unreliable.Again, this difficulty could be avoided 
by pivoting. 


| 1 0 
| 二 0 2-1ls -1+ls 10 dd 
0 -1+2/s -2/se |j1 





5 一 1 1 0 
b| =|0 -ls ls |10 
0 2/s 一 2/s | 1 
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Diagonal Dominance 


An7x7matrixAis saidto be diago7al1y do777720712t 让 each diagonal element is larger 
thanthesum ofthe otherelementsinthe samerow (wearetalkinghereaboutabsolute 
values). Thus diagonal dominance requires that 


用 
14il > 》 14 GE= 12, 用 (2.30) 
六 1 
J 关 
Eor example, the matrix 

-2 4 -1 
1 -1 3 
4 -2 1 


is not diagonally dominant but 让 we rearrange the rows in the following manner 


4 一 2 1 
= 4 一 | 
| 3 


then we have diagonal dominance. 

Itcanbeshownthatifthe coefficientmatrixAoftheequationsAx = bis diagonally 
dominant then the solution does notbenefit from pivoting; thatis, the equations are 
alreadyarrangedin the optimal order. Itfollowsthatthe strategyofpivotingshouldbe 
toreordertheequationssothatthecoefticientmatrixis as closeto diagonaldominance 
as possible. This is the principle behind scaled row pivoting, discussed next. 


Gauss Elimination with Scaled Row Pivoting 


Consider the Solution of Ax = b by Gauss elimination with row pivoting. Recall that 
pivoting aims at imnproving diagonal dominance ofthe coefficient matrix, ie making 
the pivot element as large as possible in comparison to other elements in the pivot 
IOow. The comparison is made easier 让 we establish an array s, with the elements 


2 (2.31) 





一 max | 4 


Thus Si called the scaie jacior of row 7 contains the absolute value of the largest 
elementin the ;th row ofA.Thevectors can be obtained with thefollowing algorithm: 


主 @ 二 全 卫 革 入 
SC(I) = max (abs(A(GI ,1:n))D) 


end 


区 一 2.5 Pivoting 


The re1Cive size of any element 4ij (ie relative to the largestelement in the ;th 


IOW) is defined as the ratio 


1 4 


7 一 





Si 


(2.32) 


Suppose that the elimination phase has reached the stage where the Kth row has 
become the pivotrow. The augmented coefficient matrix atthis point is shown below- 





4 4 43 4 4 | 局 
0 4 4s 424 4 | D2 
0 0 4 434 43， | 1Ds 
0 :0 4kk 4kn | 用 
0 和 二 0 4 4 已 





We dont automatically accept 4kk as the pivot elementb but look in the kth column 
below Akkfor a “better pivot. The best choice is the element 4xthat has the largest 


Ielative size; that is, we choose Psuch that 


三 关 一 JaX 三 
PE 1 


开 we fnd such an element then we interchange the rows Kand 刀 and proceed with 


theelimination pass as usual.Notethatthe correspondingrowinterchange mustalso 


be carried out in the scale factor array s. The algorithm that does all this is 


for KkK = 1:mn-1I 


% Find element with Largest frelative SIze 


% and the corresponding fow number P 
[Amax,p] = max(Cabs(ACK:n,K))./sCK:n) ) 


P= 电 二 KE=- 工 ; 


% If this element Is Very Smal1，matrix Is Singu]ar 


If Amax < eps 
erTror( "Matrix Is singular') 


end 


% Interchange fows Kk and PP If needed 


if p -= k 
b = swapRows(b,Kk,p); 


S 
A 


emnd 


SwWapRows(s,K,p) ; 


SwWapRows(A,K,p) ; 
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% ELimination pass 


end 


国 SwapDRows 


The function swapRows interchanges rowsi and j ofamatrix or VectorYV: 


function VvV = SwWapRows(Gv, 工 ,JJ) 
% Swap fows 荆 and Jj of vector or matriXx V. 
% USAGE: vv = SwapRows(Gv ,IJ) 


1 二 
(0 
V(J,:) = temp; 


国 5&ausSsSsSP]IV 


The function gaussPiv performs Gauss elimination with row pivoting. Apart from 
IOwSwapping, the elimination and solution phases are identical to those of function 
gauss in Art. 2.2. 


function X = gaussPiv(A,b) 
% Solves Ax*X = b by Gauss elimination with Yow pivoting . 
% USAGE: X = gaussPiv(A,b) 


工 芋 2ZG(D 237 > 工 3 三 … 攻 3  Gnd 
nn = LengthCGb); s = Zeros(n,1); 


和 二 二 二 二 三 二 后 二 二 全 Set up scale factor array---------- 
for = 1:nij SCI) = max(Cabs(AGTI,1:n))); end 

内 二 三 二 二 三 二 忆 二 二 EXchange Tows If necessary---------- 
for K = 1 工 :mn-I 


[Amax,pPp] = max(Cabs(ACK:n,K))./sCK:n) ) 
D=Pp+K- 1 
If Amax < epsj error(':MatTrix Is singular'); end 
If P “= 区 
b 
S 
A 


end 


swapbRows(Cb ,Kk,p); 


SWapRows(s,K,pP) ; 


SWapRows(A,K,pP) ; 
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for 工 = K+1:n 
If ACTI,k) "= 0 
Iambda A(CI,K)IVACK,K) 
A(I,k+1:n) = ACTI,k+lL:n) - ambdaxA(CKk,Kk+1:n) ; 
b(Ci) = b(Gi) - Lambdax*b(Ck) ; 


emnd 


for KkK = mn:-1: 工 
b(K) = (b(Ck) - ACK,K+1:n)*bCKk+L:n))XACGK,K) ; 


emnd 


国 直 UdqdecPIV 


The Gauss elimination algorithm can be changed to Doolittles decomposition with 
minor changes. The most important of these is keeping a record of the row inter- 
changes during the decomposition phase. In LUdecPiv this record is kept in the 
permutation array pezm initially set to [1, 2,...，,7] 1T. Whenever two rows are inter- 
changed, the corresponding interchangeis also carried outin perm. Thus perm Shows 
howthe original rows were permuted. This information is then passedto the function 
LUsolPiv which rearranges the elements of the constant vector in the Same order 
before carrying out forward and back substitutions. 


function [A,perm] = LUdecPiv(CA) 

% LU decomposition of matrix A; Teturns A = [LNU] 
% and the Tow petrmutation vector "perm ' . 

% USAGE: [A,perm] = LUdecPiv(CA) 


nn = Size(A,1); s = Zeros(n,1); 


管 记 卫 放生 ; 


% 二 全 二 宇 汪 二 千 半 守 芝 Set up scale factor array---------- 
for TIL = 1:nij s(I) = max(Cabs(ACGI,1:n))); end 

% 二 二 二 全 二 后 关 二 EXchange Tows If necessary---------- 
for KkK = 工 :Dn-I 


[Amax,p] = max(Cabs(ACK:n,K))./sCK:n) ) 
D=Pp+K- 1 
If Amax < eps 

erTror( "Matrix Is singular') 


emnd 
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主 芋 - 提 三 疏 
S = SWapRows(s,KkK,p) ; 
A = SwapRows(A,K,pP) 
Perm = SwapRows(perm,K,pP) ; 
end 
%-------------- ElLimination pass--------------- 


for 工 = KK+1:Dn 
IE ACTI,k) “= 0 
Lambdqa = A(CI,K)/ACK,K) ; 
A(CI,Kk+1:n) = ACTI,k+l:n) - ampbdaxA(CK,Kk+1:n) ; 
A(GCI,k) = Lambda; 
end 
emnd 


end 


国 LUsolLP]IV 


function X = LUsolPIiv(A,b,perm) 

% Solves LxrUx*b = X，WwWhere A contalins Tow-wise 
% permutation of L and U in the form A = [LNXU] . 
% Vector “petzm” holds the TYow permutation data， 
% USAGE: X= LIUsolPiv(A,b,perm) 


内 计 二 全 二 宇和 兰 关 过关 所 Rearrange b，store it in X-------- 
If siIize(b) > 1; b = b'; end 

D = Size(A,1) ; 

过 .三 站 


到 6 二 三 -了 人 


bCperm(I) ); end 


王 O 下 三 233 三 
XCK) = XCK) - ACK,1:K-1)*XC1L:K-1) ; 


for K = mn:-1:1 
XC(K) = (XCK) - ACK,Kk+1L:n)x*XCK+1:n))XACK,K) 


end 


When to Pivot 


Pivotinghas acouple ofdrawbacks.One oftheseis the increased costofcomputation; 
the other is the destruction of the symmetry and banded structure of the coefficient 
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matrix. The latter is of particular concern in engineering computing, where the co- 
efcient matrices are frequently banded and symmetric, a pIoperty that is utilized 
in the solution, as seen in the previous article. Fortunately these matrices are often 
diagonally dominant as wel so that they would not benefit from pivoting anyway. 

There areno infalliblerules for determining when pivoting shouldbeused. Expe- 
Iienceindicatesthatpivotingis likelyto be counterproductive 计 the coefficientmatrix 
is banded. Positive definite and, to a lesser degree, symmetric matrices also seldom 
gain from pivoting. And we should not forget that pivoting is not the only means of 
controlling roundoff errors 一 there is also double precision arithmetic. 

It should be strongly emphasized that the above rules of thumb are only meant 
for edquations that stem from real engineering problems. It is not difficult to concoct 
“textbook" examples that do not conform to these rules. 


EXAMPLE 2.12 
Employ Gauss elimination with scaled row pivoting to solve the equations Ax = b， 


where 
2 -2 6 16 
A 王 | 一 2 4 3 b 一 0 
一 1 8 4 一 1 


solution The augmented coefficient matrix and the scale factor array are 


2 二 2 6 | 16 6 
[Alp|= -2 43| 0 s 二 | 4 
-1 8 4|-1 8 





Note that s contains the absolute value of the largest element in each Tow ofA. At this 
stage, all the elements in the first column of A are potential pivots. To determine the 
best pivot element we calculate the relative sizes of the elements in the first column: 


亡 1 4 7/s 1/3 
Pl |=|1421/s | =| 1/2 
31 |4s1| /ss 1/8 


Since 72l is the biggest element we conclude that 421 makes the best pivot element. 
Therefore, we exchange rows 1 and 2 of the augmented coefficient matrix and the 
Scale factor array obtaining 


[Alp| = 2 -2 6| 16 s=|6 
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Now the first pass of Gauss elimination is carried out (the arrow points to the pivot 
Iow, yielding 





-22431100 4 
[A 员 | 二 0 2 9116 s= | 6 
0 6 5/2|_1 8 


The potential pivot elements for the next elimination pass are 422 and 43>. We 
determine the “winner ”from 


米 米 米 
122 | = | |4zz|/s | = | 1/3 
132 14a2| /ss 3/4 


Note that m2 is irrelevant since row 1l already acted as the pivot row. Therefore, it is 
excludedfrom further consideration.As maz is largerthan >z,thethirdrowis thebetter 
pivot row. After interchanging rows 2 and 3, we have 





-24 3|00 4 
[A b| = 0652| -1|， ss=|s8 
0 2 9 |16 6 


The second elimination pass now yields 


一 2 4 3 0 
ee 


[we 





This completes the elimination phase.ItshouldbenotedthatUisthematrixthat 
wouldresultintheLU decomposition ofthefollowingrow-wisepermutation ofA (the 
ordering ofrows is the same as achieved by pivoting): 


二 乞 4 3 
三 有 8 4 
2 一 2 6 


Since the Solution of Ux = c byback substitution is not affected by pivoting, we Skip 
the detailed computation. The result is x+ 一 | 1 一 1 2 | 


Alternate Solution It it not necessary to physically exchange equations during piv- 
oting. We could accomplish Gauss elimination just as well by keeping the equations 
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in place. The elimination would then proceed as follows (for the sake of brevity we 


Skip repeating the details of choosing the pivot equation): 


2 _2 61| 16 
[Alpj= -2 | 人 | 十 
-1 8 4|2-1 
0 2 9 |416 
[A | -24 3|00 





0 6 5/2|-1| 一 


0 0 49/6 | 49/13 
b| = 24 3 0 
0 6 52 | -1 


|A 





Butnowthe back substitution phaseis alitte more involved, since the order in which 
the equations must be solved has become scrambled. In hand computations this is 
not a prIoblem, because we can determine the order by inspection. Unfortunately, 
“by inspection'" does not work on a computer. TIo overcome this difficulty we have 
to maintain an integer array p that keeps track of the row permutations during the 
elimination phase. The contents ofp indicate the order in which the pivot rows were 


chosen. In this example, we would have atthe end of Gauss elimination 


2 
D=| 3 
1 


Showingthatrow2wasthe pivotrowin the firstelimination pass, followedbyrow 3 in 
the second pass. The equations are Solved by back substitution in the ITeverse order: 
equation l is solved first for xs, then equation 3 is solved for xz, and finally equation 


2yields xl. 


By dispensing with swapping of equations, the scheme outlined above would 
piIiobably result in a faster (and more complex) algorithm than gaussPiv, but the 
number of equations would have to be quite large before the difference becomes 


noticeable. 


PROBLEM SET 2.2 


1. Solve the equations Ax = b by utilizing Doolittles decompositiom, where 
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2. Use Doolittes decomposition to solveAx = b, where 


CD 


4 8 20 24 
A=| 8 13 16 hb 三 18 
20 16 一 91 一 119 


.DetermineLandD thatresult from Doolittles decomposition of the matri 这 


. Solve the tridiagonal equations Ax = b by Doolittles decomposition method， 


where 
6 200 0 2 
一 1 7 20 0 一 3 
人 A 一 0 -2 8 2 0 b 一 4 
0 0 3 7 一 2 一 3 
0 0 0 3 5 1 


.Use Gauss elimination with scaled row pivoting to solve 


4 一 2 下 X1 之 
一 2 1 一 | X2 | 三 | 一 1 
一 2 3 6 X3 0 


. SolveAx = b by Gauss elimination with scaled row pivoting, where 


2.34 -4.10 1.78 0.02 
A= | 一 1.98 3.47 ”一 2.22 b = | -0.73 
2.36 一 15.17 ”6.81 一 6.63 
. Solve the equations 
2 -1 0 X1 1 
0 0 -=! X2 | |0 
0 -1 2 -llx| |10 
-1 2 -=! 4 0 


by Gauss elimination with scaled row pivoting. 
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8. 国 Solve the equations 


0 2 5 三] X1 
2 1 3 0 X2 
一 2 ”一 1 3 1 X3 
3 3 一 1 2 X4 
9. 国 Solve the symmetric, tridiagonal equations 
4X1 一 X2 一 9 
三 所 洁 4 二 大 和 并 三 9， 丰富 和 
一 Xi_1 十 4x 一 5 
with 7 一 10. 
10. 国 Solve the edquations Ax = b, where 
1.3174 2.7250 2.7250 1.7181 
| 0.4002 0.8278 1.2272 2.5322 
”| 0.8218 1.5608 0.3629 2.9210 
1.9664 2.0011 0.6532 1.9945 
11. 国 Solve the equations 
10 -2 一 1 2 3 1 一 4 7 
5 11 3 10 一 3 3 3 一 4 
7 12 1 5 3 一 12 2 3 
8 7 一 2 1 3 2 2 4 
2 一 15 一 1 1 4 一 8 3 
4 2 9 1 12 一 4 1 
一 1 4 -7 一 | 1 1 一 1 一 3 
一 1 3 4 1 3 一 4 7 6 
12. 


=3 
3 
二 2 
5 
,1 一 工 
8.4855 
b- 4.9874 
5.6665 
6.6152 
二 1 0 
万 2 12 
X3 一 5 
X4 | 纪 
2 | | -25 
X6 一 26 
X7 9 
X8 一 7 


国 The System Shown in Fig. (a) consists of7 linear Springs that Support 7 Passes. 


The Spring stifftnesses are denoted by 襄 , the weights of the masses are 风 , and 
Xi are the displacements of the masses (measured from the positions where the 
Springs are undeformed). The so-called displace177e12tjo772ULCto1 is obtained by 
writingtheequilibrium equation ofeach mass and substituting 丈 = 应 CG+1 一 慷 ) 
for the spring forces. The result is the symmetric, tridiagonal set ofequations 


(1 十 ip)Xl 一 1iXa 一 TV 
一 店 友 -1 十 (后 十 HG 一 后 HIXA+I 一 了 


一 [poXp -1 局 jpXn 一 TV 


0E 1 
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Write a piIogram that solves these equations for given values of 1 k and W. Run 
the program with 7=5 and 


[一 心 =1 必 =10N/mm 0 一 1 一 5N/mm 
Vi = Wasa=Wi=100N =IWai=50N 








(9) (b) 


13. 国 The displacement formulation for the mass-sSpring System shown in Fig. (b) 
results in the following equilibrium equations of the masses: 





后 十 局 十 应 十 应 1 15 JJ TY 
一 上 启 十 如 一 后 X2 | 三 | 内 2 
一 语 一 aa 人 十 1 | | xs Ta 


where 5 are the Spring stifftnesses，TW; represent the weights of the masses, and 
2Xi are the displacements of the masses from the undeformed configuration of 
the system. Write a program that solves these equations, given k and W. Use the 
program to find the displacements 让 


后 = 启 = 避 = 天启 = 庙 =2K 
Wi =IW=2Ww 了 = 人 几 


14.， 力 





The displacement formulation for a plane truss is similar to that of a mass-- 
Spring System. The differences are: (]) the stiffnesses of the members are 


2.5 Pivoting 


后 = (E4/Di， where BE is the modulus of elasticity 4 represents the croSS- 
Sectional area and ZL is the length of the member; (2) there are two com- 
ponents of displacement at each joint. For the statically indeterminate truss 
Shown the displacement formulation yields the Symmetric equations Ku = p， 


where 


27.58 

7.004 

玫 王 | 一 7.004 
0.0000 

0.0000 


-7.004 0.0000 “0.0000 
-5.253 0.0000 一 24.32 
29.57 ”0.0000 “0.0000 
0.0000 27.58 -7.004 
0.0000 -7.004 29.57 
-45| 7TKN 


Determine the displacements w ofthe joints. 


15， 国 





MN/m 


In the jorce jormxiatiom of a truss, the unknowns are the member forces 已. For 
the statically determinate truss shown, the equilibrium equations of the joints 


are: 


二 下 工 
0 
一 ] 
0 
0 
0 


0 


一 1/V2 
1/V2 
0 

0 

0 

0 


0 
工 
0 
0 
0 
= 


0 
0 

一 1/V2 
1/V2 
1/V2 
一 1/V2 


己 产 串口 口 品 


where the units of P are kN. (a] Solve the edquations as they are with a computer 
prIogram. (b) Rearrange the Tows and columns so as to obtain a lower triangular 
coefficient matrix，and then solve the equations by back substitution Using a 


calculator. 
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16， 力 





The force formulation of the symmetric truss shown results in the joint equilib- 
Iium equations 


人 1 0 0 0 户 0 
0 3 0 0 1 户 0 
0 02 0 0 站 让 三 | 工 
0 --cC c 1 0 0 
0 SS 830 0 记 0 


wheres=Sinb6,c=coso and 忆 are the unknown forces. Write a program that 
computes the forces, given the angle 0. Run the program with 0 = 53?. 








17.， 力 
人 5 总 “220 V 
S | 2G 
忆 泡 吧 | 。 
/2 
AMYVYVv “0V 


The electrical network shown can be viewed as consisting of three loops. Apply- 
ing Kirhoff's law (> voltage drops = 》voltage Sources)j to each loop yields the 
following equations for the loop currents , zand zj3: 


50 十 15( 人 一 六 ) 一 220V 
有 R(P2 一 为 ) 十 522 十 102 = 一 0 


208 十 Ra 一 疡 ) 十 15(s 一 六 ) 一 0 


Compute the three loop currents for 尺 = 5 10 and 20 92. 


加 加 2.6 Matrix Inversion 


“2.6 


18， 轩 


-120 VI / ) 1+120V 








50 30 人 
| 一 人 MYYv YYVYv 
包 名 
PP |e 如 
[国王 六 克 重 


10 名 
AMVVYv 
yyvv 
15 名 











AUvvyyv 
30 包 


Determine the loop currents im to ma in the electrical network shown. 


19. 国 Consider the Simultaneous equations Ax = b, where 
站 = 
hj=G+ 妆 = >》 4j =0170-1 =01 72 一 1 
J=0 
宛 

The solution isX 一 | 1 1 …， 1|1.wWriteaprogramthatsolvestheseequations 
for any given 7 (pivoting is recommended). Run the program with = 2,3 and 4， 
and comment on the results. 


Matrix Inversion 


Computing the inverse of a matrix and solving Simultaneous equations are related 
tasks. The most economical way to invertan 7 x71 matrixAis to solve the equations 


AX=I (2.33) 


where I is the 12 x 7 identity matrix. The solution X, also of size x 1 will be the 
inverse ofA. The proof is simple: after we premaultiply both sides of Eq. (2.33) byA-1 
wehaveA-IAX = A-lL which reduces toX = A-1. 

Inversion oflargematricesshouldbe avoided wheneverpossible due its high cost. 
As seen from Eq. (2.33), inversion ofAis equivalentto solvingAxi =biIi 一 1,2,...，,71 
where bi is the ;th column ofI. 节 LU decomposition is employed in the solution, the 
solution phase (forward and back substitution) must be repeated 7 times, once for 
each bi. Since the cost of computation is proportional to 13 for the decomposition 
phaseand 12 foreach vector ofthesolution phase,the costofinversion is considerably 
Imore expensive than the solution ofAx = b (Single constant vector b). 
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Matrix inversion has another serious drawback 一 abandedmatrix loses its struc- 
ture during inversion. In other words, 让 Ais banded or otherwise Sparse, then Ar-lis 
fuly populated. However the inverse of atriangular matrix remains triangular. 


EXAMPLE 2.13 
Write afunction thatinverts amatrix using LU decomposition with pivoting. Testthe 


function by inverting 
0.6 一 0.4 1.0 
A= | -03 0.2 0.5 
0.6 一 1.0 0.5 


solution The function matInv listed below inverts any martix A. 


function Ainv = matInV(CA) 
% Inverts martix A with LU decomposition . 
% USAGE: Ainv = matInVC(A) 


nn = Size(A,1) ; 
Ainv = eye(n) ; ”% Store RHS Vectors in Alinv . 
[A,perm] = LUdecPiv(A); % Decompose A. 
% Solve for each RHS Vector and store Tesults :in AinV 
% Tep]lacjing the corresponding RHS Vector . 
for 工 = 工 :mn 

Ainv(:,I) = LIUsolLPIivCA,Ainv(: ,II) ,perm) ; 


end 


The following test program computes the inverse of the given matrixz and checks 
whetherAA-1 = 工 


% Example 2.13 (MatTrix Inversion) 
A= [0.6 -0.4 1.0 

二 0 905 wa 

056 = 下 :50290553 
Ainv = matInVC(A) 


check = Ar*AinvV 


Here are the resuljts: 


>> AlinV = 
1 工 .6667 -2.2222 - 工 .1111 
1.2500 -0.8333 -1.6667 


0.5000 工 .0000 0 


世 强 2.6 Matrix Inversion 


check = 
工 .0000 -0.0000 -0.0000 
0 工 .0000 0.0000 
0 -0.0000 工 .0000 


EXAMPLE 2.14 
Invertthe matri 


2 一 0 0 0 
一 忆 0 0 
U .= 2 一 0 
0 0 一 | 2 一 
0 0 0 一 ! 2 一 
0 0 0 0 -= 一 ! 


WP 王 己 避 唱 己 


solution Since the matrix is tridiagonal we solveAX = Iusing the functions LUdec3 
andLUso1l3 (LU decomposition for tridiagonal matrices): 


% EXample 2.14 (MatTrix Inversion) 


nn=6; 

d = ones(n,1L)*2; 
e = -ones(Cn-1,1) ; 
C = eli 

dCn) = 5 


[rc,d,e]l = ILUdec3(c ,de) 


于 GO 二 :三 并列 


b = zeros(n,1) ; 

b(Ci) = 工 ; 

从 nr 7 ELILUSsol3(4ecQnes 了 23 
emnd 
AinvV 


The result is 


>> AlnV = 
0.8400 0.6800 0.5200 0.3600 0.2000 0.0400 
0.6800 1.3600 工 .0400 0.7200 0.4000 0.0800 
0.5200 工 .0400 .5600 工 .0800 0.6000 0.1200 
0.3600 0.7200 工 .0800 工 .4400 0.8000 0.1600 
0.2000 0.4000 0.6000 0.8000 工 .0000 0.2000 
0.0400 0.0800 0.1200 0.1600 0.2000 0.2400 


Notethat although Ais tridiagonal A-lis fully populated. 
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“2.7 


lterative Methods 
Introduction 


So far wehave discussed only directmethods ofsolution. The common characteristic 
ofthesemethodsis thattheycomputethe solution with afinitenumber ofoperations. 
Moreover 计 ithe computer were capable ofinfinite precision (no roundoff errors), the 
solution would be exact. 

Iterative，oT ;172dz7ect 111e 妨 ods, start with an initial guess of the solution X and 
then repeatedly improve the solution until the change in xbecomes negligible. Since 
the required number of iterations can be very large, the indirect methods are, in 
general, Slower than their direct counterparts. HoweveD iterative methods do have 
the folowing advantages that make them attractive for certain problems: 


1. It is feasible to store only the nonzero elements of the coeffGicient matrix. This 
makes it possible to deal with very large matrices that are Sparse, but not neces- 
Sarjly banded. In many problems, there is no need to store the coefficient matr 这 
at all. 

2. Iterative procedures are self-correcting, meaning that roundoff errors (oOT even 
arithmetic mistakes) in one iterative cycle are corrected in subsequent cycles. 


Aserious drawback ofiterative methods is thatthey donotalways convergeto the 
solution. It can be shown that convergenceis guaranteed onlyifthe coef 恰 cient matri 这 
is diagonally dominant. The initial guess for xplays no role in determining whether 
conveIgence takes place 一 让 the procedure converges for one starting Vector 让 would 
do so for any starting vector. The initial guess affects only the number of iterations 
that are required for convergence. 


Gauss-seidel Method 
The equations Ax = b are in scalar notation 
玫 

>》 4ij21 = / 覃 三 0 

姜 1 
Extracting the term containing x% from the Summation sign yields 

隐 
Ai 十 》 Aij 杂 一 肋 大 全 下 骨 os 克 


号 1 
J 天 


区 一 2.7 lterative Methods 


Solving for 友 ,we get 


1 ， 
Ji 一 矶 2 )， 一 25 
J/ 产 
The lastequation suggests the following iterative Scheme 


也 
厂 二 一 | 玉 - >》 4 三 =12 (2.34) 
J=1 


We start by choosing the starting vector X. Ia good guess for the solution is not 
available,Xx can be chosen randomly Equation (2.34) is then used to recompute each 
elementofx, alwaysusingthelatestavailablevalues ofxj.This completes oneiteration 
cycle. The procedure is repeated until the changes in X between Successive iteration 
cycles become sufficiently small. 

Convergence ofthe Gauss-Seidel method canbeimprovedbyatechnique known 
as1elaxatio1.Theideaistotakethenewvalueofx asaweightedaverage ofits previous 
value and the value predicted by Eq. (2.34). The corresponding iterative formula is 


用 
CU ， 
以 访 一 》 4 + 一 oz 1 2 (2.35) 


77 j=1 


人 
Where the weight w is called the 7elaxatio7m jactor. It can be seen that 让 w = ]， 
Do Ielaxation takes place, Since Eqs. (2.34) and (2.35) produce the Same result. 下 
w < 1, Eq. (2.35) represents interpolation between the old yx and the value given by 
Eq. (2.34).This is called Pde7elaxatio1. In cases wherew > 1 wehave extrapolation， 
OIT OVeJTeLGXG1IO711. 
There is no practical method of determining the optimal value of w beforehand; 
however a good estimate can be computed duringrun time.Let Ax = |x0D 一 X0 





be the magnitude of the change in Xx during the Kth iteration (carried out without 
Ielaxation; ie with w = J). 玉 Kis sufficiently large (say 大 > 5), it can be shown2 that 
an appIoximation ofthe optimal value of w is 


2 
aopt (2.36) 


1 十 Wi 一 (Ax(erDJAAX)IP 








where pis apositive integer. 


2 See, for example, Terrence J. Akai, 4pplied Nuyzaerical Metjhods jpr Biigineers John Wiley & Sons 
(1994), p. 100. 
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The essential elements of a Gauss-Seidel algorithm with relaxation are: 


1. Carry out [iterations with ww =1 (5=10 is reasonable). After the kth iteration 
record Ax(. 

2. Perform an additional P iterations (PP> 1]) and record AxX(kt+P after the last 
iteration. 

3. Perform all subsequent iterations with w = wopt where wopt is computed from 
Eq. (2.36). 


国 5&aussSelIdel] 


The function gaussSeidel is an implementation of the Gauss-Seidel method with 
Ielaxation. It automatically computes wopt from Eq. (2.36) using 上 王 10 and 万 =1. 
The user must provide the function iterEqs that computes the improvedXxfrom the 
iterative formulas in Eq. (2.35) 一 See Example 2.17. 


function [X,numIter ,omega] = gaussSelidel(func,X,maxIter,epsiIilon) 


% Solves AX = b by Gauss-Selidel method with zelaxation . 


% USAGE : [X,numIter ,omega] = gaussSelidelL(func ,X,maxIter ,epsiIlon) 
% INPUT : 

% func = handqle of function that Teturns :improved X Using 

% the Iterative formulas in Eq. (2.35) . 

% 买 = Starting SolLution Vector 

% maxIter = allowab]le Phnumber of Iterations (default 1Is 500) 


% epsilon = error tolerance (qdqefault 1Is 1.0e-9) 
% OUTPUT : 
% = So]lution Vecto 
% PumItez = number of Iteratlions Carrlied ouUt 
% omega = Computed TelLaxation factomz 
If Pargin 4; ebpsilon = 1.0e-9; end 
If nargin 3; maxIter = 500; end 
k= 10;Pp= 1; omega = 工 ; 
for numItez = 1 工 :maxXIteT 
坟 DLLQ 三 区 ? 
X = feval(Cfunc,X,omega) ; 
dxX = Sdqrt(Cdqot(X - XO1d,X - XO1d)) ; 
If qdqx < epsilon;i returni end 


If numItez == kj qx1l = dx;i end 
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If numIter == kK + Pp 
omega = 2/(1 + Saqrt(1 - (qdqx/dx1L) (1LZpP)D)D); 
end 
emnd 


erTror( Too many Iterations ') 


Conjugate Gradient Method 


Consider the problem of fnding the vectorxthat minimizes the scalar function 
Jo = 5xrAx 一 b7x (2.37) 


wherethematrixAis sy11711etricand Positive dejijzite.Because 太 is minimized when 
its gradientV 了 = Ax--bis zero, we seethat minimization is equivalent to solving 


Ax 王 b (2.38) 


Gradient methods accomplish the minimization by iteration，starting with an 
initial vector xo. Each iterative cycle computes a refined solution 


XK+H1 一 XKE 十 QKSK (2.39) 


The step 1e18 妨 wk is chosen so that Xkrl minimizes 帮 xkl in the sed1cPp di7ectio7 Sk. 
That is, xe+l must satisfy Eq. (2.38): 





AGxk 十 wksk) 一 b (a) 
Introducing the 7esiCxCi 
IE 一 b 一 Axr (2.40) 
Eq. (aj] becomes awAsk = ITk. Premultiplying both sides by S and Solving for wk，we 
obtain 
中 一 2 (2.41) 


Weare still left with the problem of determining the search direction sk. Intuition 
tells us to choose sk = -VJ 三 = Ib Since this is the direction of the largest negative 
change in 帮 . The resulting procedure is known as the 17etpod of sfeepesf desce11 
Itis notapopular algorithm due to slow convergence. The more efficient conjugate 
gradient method uses the search direction 


SkHl 三 THl 十 RSK (2.42) 


The constant Bj is chosen so that the two Successive Search directions are co771zg8Zte 
(noninterfering) to _ each other meaning st Asr 一 0. Substituting for sk fom 
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Eq. (2.42), we get (rt 十 Bks1)Ask = 0 which yields 


T 
到 TH1ASK 


2.43 
SLASK 


大 二 
Here is the outline ofthe conjugate gradient algorithm: 


。 Choosexo (anyvector will do,but one closeto solution results in fewer iterations) 

e。 Lo < b 一 Axo 

。 So < ro (dacking a previous search direction，choose the direction of steepest 
descentb) 

。 do with 上 一 0,1,2,... 


SETK 
StASK 





CQ < 


XkHL < XK 十 CESK 
ITkHl < 二 b 一 AxkeHl 
让 ITkHll < s exitloop (Convergence criterion; s is the error tolerance) 
加 TH1ASK 
SLASK 


BF < 


SEE < TEL 十 BRSK 
e。 end do 


It can be shown that the residual vectors rl, rz,Tr3,...producedbythe algorithm 
are mutually orthogonal iem Tri =07 夭 j) .Nowsupposethatwehave carried out 
enough iterations to have computed the whole set of 2 residual vectors. The residual 
Iesulting from the next iteration must be anull vector (Cl =0), indicating that the 
solution has been obtained. It thus appears that the conjugate gradient algorithm 
is not an iterative method at all, since it reaches the exact solution after 7 compu- 
tational cycles. In practice, however convergence is Usually achieved in less than 7 
iterations. 

The conjugate gradient method is not competitive with direct methods in the 
solution of small sets of equations. Its strength lies in the handling of large, Sparse 
Systems (where mostelements ofA are zeroj. Itis imnportant to note thatA enters the 
algorithm only through its multiplication by a vector; ie in the form Av, where vis 
avVector (either Xel or sb.IAis sparse, it is possible to write an effGicient subroutine 
forthe multiplication and pass it on to the conjugate gradient algorithm. 


国 Comn]jGrad 


The function conjGrad Shown below implements the conjugate gradient algorithm. 
The maximum allowable number of iterations is set to 7. Note that conjGrad calls 
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thefunction AvCv) which returns the productAv. This function mustbe supplied by 
theuser (See Example2.18).Wemustalsosupplythe startingvectorXxandthe constant 
(right-hand-side) vector b. 


function [X,numIter] = conjGrad(Cfunc,x,b,epsiIilon) 
% Solves AX = b by conJjugate gradjient method . 
% USAGE : [xx,numItezr] = conJjGrad(Cfunc,X,b,epsilLlon) 


% INPUT : 

% func = handle of function that Teturns the Vector Ax*V 
9% 买 = Starting Solution Vectom 

% Pb = Constant Vector in Ax*X = b 

% epsilon = error tolerance (qdqefault = 1.0e-9) 

% OUTPUT : 

9% 医 = SolLution Vectom 


% numItez = number of Iterations Carried out 


If nargin == 3;) epsilon = 1.0e-9; end 
nn = LengthCb) ; 
=b - fevalCftunc,X); s = 了 ; 


for PumIter = 工 :nm 
uU = feval(Cfunc,s); 
alpha = dot(s,z)/dot(Cs ,ul) ; 
又 =X+ alphaxrs; 
=b - fevalCftunc,X); 
If sqrt(Cdot(T,z)) < epslilon 
TeturDn 
else 
beta = -dot(z,uUu)/dot(Cs,uU) ; 
S= 工 +betaxrsi; 
emnd 
end 


eTrTor( Too many Iterations ') 


EXAMPLE 2.15 
Solve the equations 


4 一 1 二 X1 12 
二 了 4 一 2 2 | 三 = 三] 
下 三 多 4 X3 5 


by the Gauss-Seidel method without relaxation , 
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solution With the given data, the iteration formulas in Eq. (2.34) become 
1 
X1 一 IT02 十 次 一 区 
1 
X2 一 世 (一 1 十 Xl 十 2X3) 
1 
JJ 三 玫 旬 一 罗 十 272) 


Choosing the starting values xl = X2 = Xa = 0, we have for the first iteration 


1 

=102 二 0 =3 
1 

X2 一 工 广 1 十 3 十 2(0)] 三 如 5 
1 

5 三 了 [5 一 3 十 2(0.5)] = 0.75 


The second iteration yields 


1 
本 (12 十 0.5 一 0.75) = 2.9375 


X1 一 
1 
X2 一 站 [一 1 十 2.9375 十 2(0.75)] 三 0.85938 
1 
X3 一 I [5 一 2.9375 十 2(0.85938)] = 0 .945 31 


andthe third iteration results in 


1 
习 一 了 (12+ 0.85938 一 0.94531) 一 2.978 52 
1 
好 一 工 [1 十 2.97852 + 2(0.94531)] = 0.96729 


1 
加 一 了 [65 一 2.97852 十 200.96729)] = 0.98902 


After five more iterations the results would agree with the exact solution Xil = 3， 
X2 一 X3a 一 1within five decimal places. 


EXAMPLE 2.16 
Solve the equations in Example 2.15 by the conjugate gradient method. 


solution The conjugate gradient method should converge after three iterations. 
Choosing again for the starting vector 


x=|o 0 o] 


国 思 2.7 lterative Methods 


the computations outlined in the text proceed as follows: 














12 4 -1 1100 12 
to 一 b 一 Axo=|-1 |1=--| 一 ! 4 一 2 0 |=| 一 ! 
5 1 -2 4||10 5 
12 
sS0 三 0 三 | = 
5 
和 ii 开 12 54 
Aso=|-l1 4 -2|1|-1|=|-26 
和 二 天 过 5 34 
STT 122 十 (一 1D)2 十 52 
oo= 一 =- 下 = 0.20142 
SITAso ”12(54) 十 (一 D) (一 26) 十 5(34) 
0 12 2.41704 
xi =xo+aoso=|0|+0.20142| -1 |= | -0.20142 
0 5 1.00710 
12 4 = 1 2.41704 1.123 32 
ri=b-Am=|-1|-|-1 4 -2||-0.20142 |=| 4.23692 
5 人 沟 1.00710 一 1.848 28 
TTAs 1.12332(54) + 4.23692( 一 26) - 1.848 28(34 
G 约 十 一 26) 9 -0133107 
SITAso 12(54) 十 (一 (一 26) 十 5(34) 
1.123 32 12 2.72076 
sl1=I+pso=| 423692 | 上 +0.133107| -1|=| 4.10380 
一 1.848 28 5 一 1.182 68 
4 -1 1 2.72076 5.596 56 
Asi=|-1 4 -2 4.10380 | = | 16.05980 
1 -2 4||1-=-1.18268 二 10.21760 
SiTl 
有 
st As 


_ 2.72076U.123 32) 十 4.103 80(4.236 92) 十 (一 1.182 68) (一 1.848 28) 
2.72076(5.596 56) + 4.103 80(16.059 80) + (--1.182 68)(--10.217 60) 
一 0.24276 
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2.417 04 2.72076 3.07753 
X2 一 Xl 十 al1S1 一 | 一 0.20142 | 十 0.24276 4.10380 | = | 0.79482 
1.007 10 一 1.18268 0.71999 
下 2 4 一 1 让 3.07753 一 0.23529 
rz 一 b 一 Axz=|--1|1=--| 一 ! 4 一 2 0.79482 | 三 0.33823 
5 1 一 2 4 0.71999 0.63215 
IT7 As) 
p) = 一 去 
S1 As) 
(一 0.23529)(5.59656) + 0.33823(16.05980) + 0.63215( 一 10.21760) 
2.72076(5.59656) 十 4.10380(16.05980) 十 一 1.18268)( 全 10.21760) 
= 0.0251452 
一 0.23529 2.72076 一 0.166876 
S2 一 LT2z 十 Bi1Sl 一 0.33823 | 十 0.0251452 4.10380 | 三 0.441421 
0.63215 一 1.18268 0.602411 
4-1 1 一 0.166876 一 0.506514 
As” 一 | -1 4 一 2 0.441421 | 三 0.727738 
1 -2 4 0.602411 1.359930 
加 LT2 S2 
“和 sj As 


(0.23529)( 一 0.166876) 十 0.33823(0.441421) 十 0.63215(0.602411) 
 (-0.166876)(--0.506514) + 0.441421(0.727738) 十 0.602411(1.359930) 





一 0.46480 
3.07753 一 0.166876 和 99997 
X3 一 X2 十 2S2 一 | 0.79482 | 十 0.46480 0.441421 | 三 | 0.99999 
0.71999 0.602411 0.99999 


The solution xs is correct to almost five decimal places. The Small discrepancy is 


caused byroundofft errors in the computations，. 


EXAMPLE 2.17 


Write a _ computer program to solve the following 7 simultaneous equations3 by 
the Gauss-Seidel method with relaxation (the program should work with any 


3 Equations ofthis form are called cyclic tridiagonal. They occur in the finite difference formulation 


of second-order differential equations with periodic boundary conditions. 
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value of 7: 

2 -1 0 0 0 0 0 1 X1 0 

-1 2 -1 0 0 0 0 00 X2 0 

0 -1 2 一 ! 0 0 0 00 X3 0 

0 0 0 0. -1 2 -1 0 X11_2 0 

0 0 0 0. 0 = 2 一 ! X17_1 0 

1 0 0 .0.0 0 =-1 2 1 1 
Run the program with 刀 = 20. The exact solution can be shownto bexi = 一 /4 十 1/2， 
全 


solution Im this case the iterative formulas in Eq. (2.35) are 
Xl 一 O(X2 一 X/ 人 2 十 人 一 四 和 
好 一 OO 1 二 MX/ 人 2 二 (1 一 oX， TI 一 2,3,... ,7 一 1 (al 
入 二 OU 一 Xi 十 XI 人 2 十 (1 一 OO) 

which are evaluated by the folowing function: 


function X = fex2_17(X,omega) 


% Iteration formula Edq. (2.35) for Example 2.17. 


Dn = Length(CX) ; 
X(1) = omegar(X(2) - XCn))/X2 + (1-omega)xx(1L) ; 
for 工 = 2:Dn-I 
X(I) = omega*r(X(CI-1L) + X(CI+1))VX2 + (1-omega)x*x(CI) ; 
end 


X(n) = omega *(1 - X(1) + XCn-1))VX2 + (1-omega)x*x(Cn) ; 


The solution can be obtained with a single command (note that X=0is the 


Starting VectorT): 
>> [X,numIter ,omega]l = gaussSelidel(Qfex2_17,zeros(20,1)) 
Iesulting in 
区 三 
-4.5000 
-4.0000 
-3.5000 
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=255000 
-2.0000 
- 工 .5000 
- 工 .0000 
-0.5000 
.0000 
.5000 
.0000 
.5000 
.0000 
.5000 
.0000 
.5000 
.0000 
.5000 

5.0000 
DuUmItez = 

259 

omega = 

1 LO055 


己 


心心 mwmPNPP 六 口 


The convergence is very Slow because the coefficient matrix lacks diagonal 
dominance 一 Substituting the elements ofAin Eq. (2.30) produces an equaljity rather 
than the desiredinequality. 芝 we were to change each diagonal term ofthe coefficient 
matrix from 2 to 4,Awould be diagonally dominant and the solution would converge 
in only 22 iterations. 


EXAMPLE 2.18 
Solve Example 2.17 with the conjugate gradient method, also using 刀 = 20. 


solution For the given A, the components ofthe vector Av are 
(人 Avl = 2 和 1 一 几 十 功 
(Av)i = 一 W 1 十 2 太一 Vi 7IL 一 2,3,... ,天 一 1 
(人 Awu = 一 0r-1 十 2 夯 十 妃 


which are evaluated by the following function: 


function AVv = fex2_18(v) 
% Computes the product A*V in ExXxample 2.18 
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nn = LengthCv) ; 

Av = zeros(n ,1) ; 

Av(1) = 2x*V(1) - VC(2) + VCn) ; 

Av(2:n-1) = -VCL:n-2) + 2xV(2:n-1) - VC3:n) ; 
AvCn) = -VCn-1) + 2xVCn) + VC1) ; 


The program shown below utilizes the function conjGraqd. The solution VectorXX 
is initialized to zero in the program, which also sets up the constant vector b. 


% Example 2.18 (ConJjugate gradient method) 
nn = 20; 

X = Zeros(n,1) ; 

三 三世 G 荆 OSI 并) (mm 三 业 ， 

[X,numItez] = conJjGrad(CQfex2_18,X,b) 


Running the program results in 


-4.5000 
-4.0000 
-3.5000 
-3.0000 
-2.5000 
-2.0000 
-1 工 .5000 
-1 工 .0000 
-0.5000 
0 
.5000 
.0000 
.5000 
.0000 
.5000 
.0000 
.5000 
.0000 
.5000 
5.0000 
DuUmItez = 三 
业 g 


省 洗 mwNhPb 由 上品 
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PROBLEM SET 2.3 





1， Let 
3 一 1 2 0 1 3 
A 一 0 1 3 了 一 3 一 1 2 
一 2 2 一 4 一 2 2 一 4 


note that B is obtained by interchanging the first two rows ofA).Knowing that 


0.5 0 0.25 
A-I=| 0.3 0.4 0.45 
一 0.1 0.2 一 0.15 
determine B-1. 


2. Invert the triangular matrices 


2 4 3 2 0 0 
A=|0 6 5 B=|3 4 0 
0 0 2 4 5 6 
3. Invert the triangular matriX 
1 1/2 1/4 1/8 
A 一 0 1 1 了 9 
0 0 1 1/4 
0 0 0 1 
4. Invert the following matrices: 
1 2 4 4 -1 0 
(A=|1 3 9 (bD)B=|-L1 4 -= 
1 4 16 0 -1 4 
5. JInvert the matrix 
4 -2 1 
A=|-2 1 -一 ! 
1 -2 4 
6. 国 Invert the following matrices with any method: 
5 -3 一 1 4 -1 0 0 
A 二 -2 1 1 1 B -1 4 -1L1 0 
3 -5 1 2 0 -1 4 一 ! 
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7. 


10. 


国 Invert the matrix with any method; 


1 3 -9 6 4 

2 二 1 6 7 

A=| 3 2 二 5 5 
8 三 1 1 4 2 

1 1 .= 一 2 .18 7 


and comment on the reliability of the result. 


. 国 The joint displacements u of the plane truss in Prob. 14, Problem Set 2.2 are 


related to the applied joint forces p by 
上 上 u 王 P (a) 


where 


27.580 7.004 一 7.004 0.000 0.000 
7.004 29.570 一 5.253 0.000 ”一 24.320 
下 三 | -7.004 一 5.253 29.570 0.000 0.000 | MN/Am 
0.000 0.000 0.000 27.580 ”一 7.004 
0.000 ”一 24.320 0.000 一 7.004 29.570 


is called the sjjpzess 12C1rix ofthe truss. 二 Eq. (aj is inverted by multiplying each 
side byK-l, we obtainu = K-1p, whereK-lisknown as the jexzzpizty72atrix.The 
physical meaning oftheelements oftheflexibilitymatrixis: 天 罗 一 displacements 
U =12,...5) produced by the unit load 矿 =1. Compnute (aj] the flexibility 
matrixofthetruss; (b) the displacements ofthejoints duetotheload ps5 = -45 kN 
(the load shown in Problem 14, Problem Set 2.2). 


， 国 Invertthe matrices 


3 一 7 45 21 1 1 1 1 
12 11 1 

A 一 0 1 B 二 直人 之 
6 25 一 80 一 24 23 4 4 
攻 7 55 三 9 到 45 6 7 


国 Write a pIogram for inverting a7x 7 lower triangular matrix. The inversion 
pirocedure should contain only forward substitution. Test the program by invert- 
ingthe matrix 


36 0 0 0 


天 下 1]8 36 0 0 
9 12 36 0 
5 4 9 36 


Letthe program also checkthe result by computing and printing AA-1. 
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11. Use the Gauss-Seidel method to solve 


=2 5 9 X1 下 
了 1 X2 | 一 6 
一 3 7 一 】 X3 一 26 


12. Solve the following equations with the Gauss-Seidel method: 


1l12 -2 3 11Ta 0 
-2 15 6 -3||jx| |00 
1 6 20 -4||1x| |20 
0 =3 2 91 起 0 


13. Use the Gauss-Seidel method with relaxation to solve Ax = b, where 


4 一 1 0 0 15 
一 站 4 一 0 
A 一 b 二 10 
U 和 = 4 一 10 
0 0 一 1 3 10 


Take 克 = 以/4rasthestartingvectorandusew= 1.1fortherelaxation factor. 


14. Solve the equations 


分 二 上 | 0 X1 
一 并 2 一 | X2 | 一 
0 一 1 1 X3 


by the conjugate gradient method. Start withx = 0. 


15.， Use the conjugate gradient method to solve 


3 0 一 1 1 4 
0 4 一 2 X2 | 三 10 
一 一 2 与 X3 =10 


starting with Xx = 0. 


16. 国 Solve the Simultaneous equations Ax = bb and Bx=b by the Gauss-Seidel 
method with relaxation, where 


人 
b= | 10 -8 10 10 -8 10| 
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8 王 2 1 
=2 4 =2 
1 一 2 4 
0 1 一 2 
0 0 1 
0 0 0 
和 二 1 
-2 4 一 2 
1 -2 4 
0 下 ”二 之 
0 0 1 
工 0 0 


0 0 0 
1 0 0 
一 2 1 0 
4 一 2 工 
-2 4 一 2 
T .=2 和 2 泡 
0 1 

1 0 0 
一 之 1 0 
4 一 2 1 
-2 4 一 2 
三 2 3 


Note that Ais not diagonally dominant, but that does not necessarily preclude 


COlTVergence. 


17. 


4 一 1 
二 汪 4 
0 三 1 
0 0 
0 0 
1 0 


0 


二 二 


4 


0 
0 
0 


0 0 0 
0 0 0 
下 0 0 
0 = 由 4 
0 0 二 站 
0 5 0 0 


国 Modify the program in Example 2.17 (Gauss-Seidel method) so thatitwill solve 
the folowing equations: 


0 了 四 0 
0 0 X2 0 
0 0 X3 0 
一 | 0 X11_2 0 
4 一 1 光 记 二 0 
一 1 4 了 100 


Runtheprogram with 刀 = 20andcomparethenumberofiterations with Example 


2 
18. 


国 Modify the program in Example 2.18 to solve the equations in Prob. 17 by the 


conjugate gradient method. Run the program with 九 王 20. 


19， 国 








和 =:1900 





7 了 E0 
1 2 3 
7T-oL_ 4 5 6 
7 8 9 
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The edges of the square plate are kept at the temperatures Shown. Assuming 
steady-stateheatconduction,the differentialequation governingthetemperature 
了 in the interior is 


3 了 | 2 1 
ax 32 


Ithis equation is appIroximated by finite differences using the mesh showmn， 
we obtain the folowing algebraic equations for temperatures at the mesh 


points: 
一 4 1 0 1 0 .0 .0 0 0 全 0 
1 -4 1 0 1 0 .0 0 0 也 0 
0 1 -4 0 0 1 0 0 0 了 3 100 
1 0 0 -4 1 0 1 0 0 隐 0 
0 1 0 1 -=4 1 0 1 0 五 | = 三 一 0 
0 0 让 0 1 -4 0 0 1 6 100 
0 0 0 1 0 0 -=4 1 0 了 200 
0 0 0 0 1 0 1 一 4 1 8 200 
0 0 0 0 0 1 0 1 一 4 79 300 


Solve these equations with the conjugate gradient method. 


1IATLAB Functons 


x = AbreturnsthesolutionxofAx = b,obtainedbyGauss elimination.Iftheequa- 
tions are overdetermined (A has more rows than columnsj, the least-squares 
solution is computed. 

[L,U] = lu(CA) Doolittles decomposition A = LU. On return, Uis an upper trian- 
gular matrixz and 工 contains a IOow-wise permutation of the lower triangular 
Iatrix. 


[M,U,P] = Ju(CA)returnsthesameUasabove,butnowMisalowertriangularmatrix 
andPis the permutation matrix so thatM = Px*L.Note that here P*A = M*U. 


chol(A) Choleskis decomposition A = LL7. 


局 
中 


B = invCA) returns B as the inverse ofA (the method usedis not specified). 


na = norm(A,1) returns the norm = maxj 2 ;14 中 dargest sum of elements in a 
column of A). 


c = cond(A) returns the co1di1o7 2U12Der ofthe matriA. 
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MATILAB does not cater to banded matrices expjlicitly However banded matrices 
can be treated as a Spa1se 11211ices for which MATLAB provides extensive Support,. A 
banded matrix in sparse form can be created by the following command: 


A = spdiags(B,dq,n,n) createsa1x71sparsematrix from the columns ofmatrix 
Bbyplacing the columns along the diagonals specified by da. The columns of B 
may be longer than the diagonals they represent.A diagonal in the upper part 
ofAtakes its elements from lowerpart ofa column ofB, while alower diagonal 
uses the upper part of B. 


Here is an exzample of creatingthe5 x5tridiagonal matrix 


2 一 0 0 0 

三 王 2 0 0 

A== 9 守业 2 = 0 
0 有 三 1 号 下 


>> C = ones(5 ,1) ; 

>> A = Spdiags([-c 2x*c -c]l,[-10 1],5,5) 

A = 
《于 5 了 7 2 
《2, 工 ) - 工 
《1L，,22 - 工 
(2 ,2) 2 
(3 ,2) - 工 
(25839 - 工 
《337 2 
(4，,3) - 工 
(3 ,4) - 工 
〈《4;42 2 
(5 ,4) - 工 
(4,5) - 工 
(65559 2 


Hthe matrix is declared sparse, MATLAB stores only the nonzero elements of the 
matrixtogether with information locating the position ofeach element in the matrix. 
Theprintoutofasparse matrix displays thevalues oftheseelements andtheir indices 
(row and column numbers) in parentheses. 

Almost al matrixz functions, including the ones listed above, also work on sparse 
matrices. For example，[L,U] = lu(CA) would returmn L and U in Sparse matriX 
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Iepresentation 让 A is a Sparse matrix. There are many Sparse matrix functions in 
MATILAB; here are just afew of them: 


A = ful1(S) converts the Sparse matrix S into a full matrix A. 
S = sparse(A) converts the ful matrix A into asparse matrix S. 
x = 1sqr(A,b) conjugate gradient method for solving Ax = b. 


spy(S) draws amap ofthe nonzero elements of S. 


3 Interpolation and Curve Fitting 


Givenitneyaqataipoinisi 二 | 天王 吉本 2 /2 Eestiimatey 人 oj 


3.1 Introduction 


Discrete data sets, or tables of the form 





X1 | X2 |X3 | | 徊 


JJ Ja | Ji | 较 


























are commonly involved in technical calculations. The source of the data may be ex- 
perimental observations or numerical computations. There is a distinction between 
interpolation and curve fitting. In interpolation we constructa curve throughthe data 
points. mm doingso, wemaketheimplicit assumption thatthe datapoints are accurate 
and distinct. Curve fittingis appliedto datathat contain scatter (noisej, usually due to 
measurementerrors. Here we wanttofindasmooth curvethat approximates the data 
in Some sense. Thus the curve does not have to hit the data points. This difference 
between interpolation and curve fitting is ilustrated in Fig. 3.1. 


3.2 “Polynomial Interpolation 
Lagrange's Method 


The simplestform ofan interpolantisapolynomial.Itis alwayspossibleto constructa 
unique polynomial P，1(x) of degree 刀 -1Lthatpasses through 7 distinct data points，. 
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Curve 册 mgsw 
Interpolation、 -一 





Figure 3.1. Interpolation and curve fitting of data. 








One means of obtaining this polynomial is the 名 772Via of Lagra118e 








了 肥 
Pi00 = 》 Jp (3.1a) 
记 1 
where 
站 一 1 炒 一 区 2 光一 : 风 光一 克 计 1 下 一 加 
刀 (X)] 一 
好 一 X1 Xi 一 X2 好 一 Xi-1 Xi 一 Xi 计 1 Ji 一 Jo 
也 
一 X) 
一 十， 一 1,2,...,7 (3.1b) 
产 1 姑 一 好 
J 产 


are called the cd170772C1 包 72czo15. 
For example, 计 = 2,theinterpolantis the straightline 局 (x) = Ja21(X) 十 yzlz(O， 
where 
交 一 炎 2 光一 光 1 


ta 三 
X1 一 X2 X2 一 X1 


CO0 三 








With 刀 = 3,interpolation is parabolic: 忆 (x%) = JJ11(00 十 yztz(X 十 yats(00,wherenow 


(一 X2)(X 一 X3) 








秦 一 
1 (xl 一 X2)(X1 一 X3) 
(一 X1)(X 一 X3) 
秦 一 
2 (xa2 一 X%1)(X2 一 X3) 
2 二 (一 X1)(OX 一 X2) 





(Xa3 一 X1)(Xas 一 X2) 


The cardinal functions are polynomials of degree7-- 1 and have the property 
0 证 大 -7 
coo=| | G.2) 


where 5ij is the Kronecker delta. This property is iustrated in Fig. 3.2 for three-point 
interpolation (12 = 3) with xl = 0, xz 一 2andXas = 3. 
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Figure 3.2. Example of quadratic cardinal functions. 


To prove that the interpolating polynomial passes through the data points，we 
Substitutex = Xij into Eq. (3.1a] and then utilize Eq. (3.2). The result is 


忆 -1G0]) 二 >》 Jo 王 >》 5 三 J 
放 1 记 1 


It can be shown that the error in polynomial interpolation is 


区 一 XU 一 2X2). = 向 
12! 





Fo0 - P，100 = 四 (6) (3.3) 


where 5 lies somewhere in the interval (xzl, Xi its value is otherwise unknown. It is 
instructive to note that the farther a data point is from x, the more it contributes to 
the erroOT at X. 


Newton's Method 


Evaluation ofpolynomial 

Although Lagranges method is conceptually simple, it does not lend itselfto an e 仁 - 
cientalgorithm.Abettercomputational procedureis obtained with Newtons method， 
where the interpolating polynomial is written in the form 





万 -1 三 QI 十 (一 习 )02 十 (人 一 和 )( 一 入)03 十 :十 (人 一 和 )G 一 和 (一 XUGn 


This polynomial lends itself to an efcient evaluation procedure. Consider for 
example, four data points (7 = 4). Here the interpolating polynomial is 


户 (X 三 QI1 十 (一 X1)02 十 (一 XXX 一 X2)03 十 (一 XI 一 X2)(X 一 X3)04 





一 0G1 十 (一 Xl){az 十 (X 一 X2)[C3 十 (一 X3)04]} 
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which can be evaluated backward with the following recurrence relations: 
O0 = 04 
已 o0 =03 十 作 一 X3)PO0 
记 o0 =02 十 人 一 X2) 记 (OO 
访 (0 三 01 十 一 X) 户 (OO 
For arbitrary 7 we have 


Pi = PCO] = CE 二 (一 XRDP IOO，K=12,... ,7 一 1 (3.4) 


国 mewtonPoly 


Denoting the x-coordinate array ofthe datapoints byxData, andthe number ofdata 
points by 1 we have the following algorithm for computing 已-1(00): 


function P = newtonPoly(a,XxData,X) 

% Returns value of Newton's polynomial at 斑 . 

% USAGE: P = newtonPoly(a,XxData,X) 

% = _ coefficient array of the polynomial; 
% must be computed first by newtonCoeff . 


% xData = X-Ccoordinates of data pojints . 


nn = LengthCxData) ; 
P = aGCn) ; 
for K = 1L:n-1; 
PP = a(Cn-k) + (X - XDataCn-K))*pi 


Computation of coefficients 
The coefhcients of P，1(x) are determined by forcing the polynomial to pass through 
each datapoint': 太 = 忆 _100) 一 12,..., 71.Thisyields the simultaneous equations 


JJ/1L 三 0G1 
]J2 三 0G1 十 (X2 一 X1)02 


Ja 三 01 十 (X3s 一 X1)02 十 (X3 一 X1)(X3 一 X2)03 (al 


萝 三 0G1 十 (一 XI 十 :十 (Oo 一 X1Oo 一 X2) .00 一 改 -1)Gn 


3.2 Polynomial Interpolation 


Introducing the divided dieremces 





V 太 = 时 二 和， 一 23 
光一 光 1 
VJ 一 V 
V2 太 = ~ 34.7 
Xi 一 X%2 
V2 2 
人 (3.5) 
Ji 一 X3 


人 胁 一 





the solution of Eqs. (a) is 
01=J de=Vj ads=V2 …， r=V"n (3.6) 


Ithe coefficients are computed by hand, it is convenient to work with the format in 
Table 3.1 (Shown for 刀 = 5). 





X1 | J 儿 1 
X2 || y2 | YJ2 
X3 | Ja | VYJa | V2Ja 
24 | Ja YIJa | Ya | Ya 
X5 | J6 | VJ5 YV265 | V3J5 | VY46 












































Table 3.1 


The diagonalterms (y1, Vy2， V2 Ja3， V3 Jaand 尽 : ]J5) in thetable arethe coefficients 
ofthepolynomial.Ifthedatapoints arejlistedin adiffterentorder theentriesinthetable 
will change, but the resultant polynomial will be the same 一 recall that a polynomial 
of degree7- 1l interpolating distinct data points is unique. 


国 mewtonCoe 了 ff 





Machine computations are best carriedout within aone-dimensional arrayaemploy- 
ingthe following algorithm: 


function a = PhnhewtonCoeff(xData,yData) 


% Returns_ coefficients of Newton's polLlynomjial. 
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% USAGE: a = newtonCoeff(xData,yData) 
% xData = X-Ccoordinates of data pojints . 


% YData = Yy-coordinates of data pojints ， 


吕 
中 


engthCxData) ; 


几 
中 


YData 
王 O 芭 鉴 三 - 23 六 
aCk:n) = (a(Kk:n) - aCK-1))./CxDataCKk:n) - XData(CK-1L) ) ; 


end 


Initially a contains the Jy-values of the data, so that it is identical to the second 
column in Table 3.1. Each pass through the for-loop generates the entiries in the next 
columm, which overwrite the corresponding elements of a. Therefore, aends up con- 
taining the diagonal terms of Table 3.1; ie., the coefGicients of the polynomial. 


Neville Method 


Newtonsmethod ofinterpolation involves two steps: computation ofthe coefficients,， 
followedbyevaluation ofthepolynomial.This works welliftheinterpolation is carried 
out repeatedly at different values ofx using the same polynomial. Honly one point is 
to be interpolated a method that computes the interpolant in a single step, Such as 
Nevilles algorithmy is a better choice. 


Let 挛 Ci, Xi ,Xi denote the polynomial of degree Kthat passes through 
the 十 1 data points (0 J 站 CT JJ Ci JEFor a single data point we 
have 

媚 [D] = 芒 (3.7) 


The interpolant based on two data points is 


(一 Xi1D)PDG TOG 一 加 而 [X 计 1] 
Ji 一 区 计 1 





妃 [Li, Xi+1] 三 


It is easily veriftied that 妃 [i,Xi1l] passes through the two data points; that is, 
户 D,XH+I 三 其 Whenx= 和 and 户 DiXi+l 一 JHLWhenxX 三 Xi+1， 
The three-point interpolant is 
(一 Xi2) 户 Di, XI 十 Ci 一 加 已 [1 Xi+3] 
Ji 一 龙 i 二 2 





忆 [i, Xi+1, Xi+2] 一 


To showthatthis interpolant does intersectthe datapoints, we firstsubstituteX 一 Xi 
obtaining 


天 [Xi XiH2] 三 态 D Xi 三 功 
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Similarly x = Xi+2 yields 
忆 [G, Xi+1, Xi+2] 一 已 [Xi+1, Xi+2] 一 功 +2 
Finally when x = Xi+l we have 
忆 [i, Xi+H1] 三 已 [Xi+l, Xi+2] 三 入 +1 
So that 
(Ci+1 一 Xi2)JJP+1 十 (Ci 一 XiH1)JJ+1 


忆 [i, Xi+1, Xi+2] 一 一 六 +1 
Ji 一 北 i2 





Having established the pattern，we can now deduce the general recursive 
formula: 


天 DCi Xi1， .Xi 计生 (3.8) 


(一 XRD Xi TI] 十 (OOGi 一 2P ICi1LXiH2，. .Xi 
Xi 一 北 计 大 





Given the value of x, the computations can be carried out in the following tabular 
format (Shown for four data points): 


K=0 E=1 大 =2 丰 =3 





Xl | Pbp=O | 已 De,xX2z] | 已 [KiX2,X3] | 启 [LXl,X2,X3,X4] 





X2 | 有 xz]==]a | 已 [xz2,X3] | 户 [D 和 2 Xa,X4] 


X3 | 古 Fxas]l = Ja | 已 [xza,X4d] 


























X4 | 书 [x4] = Ja 


Table 3.2 





国 mevlI]l]e 


This algorithm works with the one-dimensional array which initially contains the 
]J-values of the data (the second column in Table 3.2). Each pass through the for- 
loop computes the terms in next column of the table, which overwrite the previous 
elements ofy. Atthe end ofthe procedure,y contains the diagonal terms ofthe table. 
The value ofthe interpolant (evaluated at xz] that passes through all the data points is 
Jl the first element of V. 


function YInterp = neville(CxData,yData,X) 
% NeviIlle's polynomjial interpolation; 


% Teturns the value of the :Interpolant at 区 ， 
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% USAGE : YInterp = mneville(CxData,yData,X) 
% xData = X-Ccoordinates of data pojints . 


% YData = Yy-coordinates of data pojints . 


吕 
中 


engthCxData) ; 

YData 

for K = 1 工 :mn-I 

Y(C1L:n-k) = ((X - XData(Ck+1l:n)).*y(1:n-kK)... 
+ (XData(1:n-K) - X) .xy(2:n-kK+1))... 
./(XData(1:n-k) - xData(Ck+1L:n) ) ; 


区 
中 


end 


YInterpP = Y(C1) ; 


Limitations of Polynomial Interpolation 


Polynomial interpolation should be carried out with the fewest feasible number of 
data points. Linear interpolation, using the nearest two points, is often sufficient 让 
the datapoints are closely spaced. Three to s 这 nearest-neighborpoints produce good 
Iesults in mostcases.An interpolantintersectingmorethan spoints mustbeviewed 
with suspicion. Thereasonis thatthe datapoints thatarefarfromthepointofinterest 
do not contribute to the accuracy of the interpolant. In fact they can be detrimental. 

The danger ofusingtoo manypoints is ilustrated in Fig. 3.3. There are 11 equally 
Spaced datapoints Tepresented bythe circles. The solid line is the interpolant apoly- 
nomial of degree ten, that intersects all the points. As seen in the figure, apolynomial 
ofsuch ahigh degree has atendency to oscillate excessively between the data points. 
A much smoother result would be obtained by using a cubic interpolant spanning 
four nearest-neighbor points. 





1.00 
0.80 
0.60 
)》 0.40 
0.20 


0.00 














-0.20 上 
-6.0 -4.0 -2.0 


一 
三 
六 
它 
匡 
已 
CN 
它 


FEigure 3.3. Polynomial interpolant displaying oscillations. 
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Polynomial extrapolation (interpolating outside the range of data points) is dan- 
gerous.As an example, considerFig.3.4.Therearesixdatapoints,shown as circles.The 
fifth-degree interpolatingpolynomial is represented bythe solidline. The interpolant 
looks fine within the range of data points, but drastically departs from the obvious 
trendwhenx > 12.Extrapolatingyatx = 14,forexample,wouldbeabsurdinthis case. 


400 





3009 一- 


了 


ee 











-100 
2.0 4.0 6.0 8.0 10.0 12.0 14.0 16.0 


Figure 3.4. Extrapolation may notfollow the trend of data. 


H 开 extrapolation cannot be avoided, the following two measures can be useful: 


。 Plotthe data and visually verify that the extrapolated value makes Sense. 

。 Use a low-order polynomial based on nearest-neighbor data points. A linear or 
quadratic interpolant for exzample, would yield areasonable estimate of y(14) for 
the data in Fig. 3.4. 

。 Work with aplot oflogxvs.log]J, which is usually much smoother than the X-] 
curve, and thus safer to extrapolate. Frequently this plot is almost a straight line. 
This is ilustrated in Fig. 3.5, which represents the logarithmic plot of the data in 
Fig. 3.4. 





100 














10 
] 


FEigure 3.5. Logarithmic plot ofthe data in Fig. 3.4. 
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EXAMPLE 3.1 
Given the data points 

















7 | 11 








28 








Use Lagranges method to determine y atX = |. 




















Solution 
GE- 功 E- 动 _Q-204-3_ 1 
-Ca 一 xz (0-2(00-3) 3 
le 
”oo 下-x) CC-0C 一 3) 
= 动人 -UL 区 1 
”0 08-27 3 
7 28 
二 Ja1 十 jz 人 2 十 Ja 人 3 一 3 十 寺 一 本 二 4 
EXAMPLE 3.2 
The data points 
关 一 2 | | 4 | 一 1 马 一 4 
y| -112|59| 4|24|-53 
































lie on a polynomial. Determine the degree of this polynomial by constructing the 
divided difference table, similar to Table 3.1. 
































Solution 
让 | YY YY 
1|-2| -1 
2| 1| 2| 1 
3| 4| 59| 10 3 
4|-1| 4| 5| -2 1 
5| 3| 24| 5 2 1 0 
6|-4|-53| 26| -5 1 0 0 
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Here are a few sample calculations used in arriving at the fgures in the table: 


Ja- 59-(D 











Vya 一 一 一 10 
)3 一 冯 全 4 己 本 
VJas 一 V]J> 10 一 工 
V213 一 一 一 3 
JS 三 3 一 水 2 4 一 1 
允 2 二 允 ? 二 5 三 治 
Vay6 = J]/6 Ja _ -1 
业 一 光 3 一 4 一 4 


From the table we see that the last nonzero coefficient (last nonzero diagonal termy) 
of Newtons polynomial is V3ya, which is the coef6icient ofthe cubic term. Hence the 
polynomial is a cubic. 


EXAMPLE 3.3 
Given the data points 





蕊 4.0 3.9 3.8 3.7 
] | 一 0.06604 | -0.02724 | 0.01282 | 0.05383 





























determine theroot of y(x) = 0 by Neviles method. 


solution This is an example of iverse it1erpolatio11, where the roles of x and y are 
interchanged. Instead of computing y at a given x, we are finding x that corresponds 
to a given y (in this case, y = 0). Employing the format of Table 3.2 (with x and ) 
interchanged, of coursej, we obtain 




















攻 西口 三 姑 | 辣 | 殊 和 | 记 [5，] 
1 | 一 0.06604 4.0 3.8298 | 3.8316 3.8317 
2 | 一 0.02724 3:9 3.8320 | 3.8318 

3 0.01282 3.8 3.8313 

4 0.05383 7 





























The following are a couple of sample computations used in the table: 


必 一 Jo 而 DJ + OO 一 切 疡 [yz] 











忆 [)a, Jaz] 三 
1 ]J2 ]J1 一] 
_ (0 十 0.02724)(4.0) 十 (一 0.06604 -- 0)(3.9) 二 3.8298 
一 0.06604 十 0.02724 
DJ 一 Jg 斑 Da Ja 二 ga 一 月 户 Da JJ 
一 J4g) 瑟 [ys JJ2 一 吃 司 [3 J4 


JJ/2 一 J4 


_ 一 0.05383)G8.8320) + (一 0.02724 一 0)G3.8313)  。 838 
三 二 0.02724 二 0.05383 本 
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All the Ps in the table are estimates of the Toot resulting from different orders 
of interpolation involving different data points. For example, 户 [i, yz] is the root 
obtained from linear interpolation based on the first two points, and 了 饭 [Jy2z, ya, Jy4] is 
the result from quadratic interpolation using the last three points. The root obtained 
from cubic interpolation over all four data points is x = 馈 [Jy1, yz, ya, y4] = 3.8317. 


EXAMPLE 3.4 


The data points in the table lie on the plot of /zx) = 4.8 cosrxX/20. Interpolate this 
data by Newtons method atXx= 0,0.5, 1.0,.. ,8.0 and compare the results with the 


“exact ”values given by]y = /20). 





光 0.15 


2:30 


3]5 


4.85 


6.25 


4&.95 

















y | 4.79867 


4.49013 


4.2243 








3.47313 





2.66674 





1.51909 





Solution 


% EXample 3.4 (Newton's interpolation) 
站 53 065257595]3 
3.473133 


文 Da 三 [OO 工 5 2 号 


YData [4.79867; 4. 


二 业 5 
49013 ; 


4.22430 ; 


2.66674; 1.51909]; 
a = newtonCoeff(xData,yData) ; 


入 YImnteT 
于 oO 区 二 08402537 5 
Y 


P YEXact 


newtonPoly(a,XData,X) ; 


YEXact = 4.8*cos(CpPI*X/X20) ; 
fpTintf('%10.5f 7” ,X,Y,YEXact) 


持 阿 到 主 站 二 本 CC” 入 而 


end 


The results are: 


ans 一 
买 YInterp 
0.00000 4.80003 
0.50000 4.78518 
1.00000 4.74088 
1.50000 4.66736 
2.00000 4.56507 
2.50000 4.43462 
3.00000 4.27683 
3.50000 4.09267 


YE 
.8 
= 
.6 
,5 
.人 4 
:2 
0 


心心 心心 心 洗 洗 小 


XacCt 
0000 
8520 
4090 
6738 
6507 
3462 
7683 
9267 
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4.00000 35-88327 3.88328 
4.50000 3.64994 3.64995 
2.00000 3.39411L 3.39411 
2.50000 呈 芋 735 3. 工 7Z35 
6.00000 2282 王 37 2.82137 
6.50000 2.50799 2950799 
7.00000 22 症 795 2.17915 
7.50000 工 .83687 工 .83688 
8.00000 工 .48329 工 .48328 


3.3 “Interpolation with Cubic Spbpline 


Ithere are more than a few data points, a cubic spline is hard to beat as a 8obal 
interpolant. It is considerably “stiffer "than a polynomial in the sense that it has less 
tendency to oscillate between data points. 


一 Elastic strip 







Eigure 3.6. Mechanical model ofnatural cubic spline. 
Pins (data points) 
X 


Themechanical modelofacubicsplineis shown in Fig.3.6.Itisathin,elastic strip 
thatis attached with pinstothe datapoints.Becausethe strip is unloadedbetween the 
pins, each segment of the spline curve is a cubic polynomial 一 recall from beam the- 
orythatthe differential equation for the displacementofabeam is d4y/adx4= 9q/(BED， 
So that y(O is a cubic since the load 9qg vanishes. At the pins, the Slope and bending 
moment (and hence the second derivative) are continuous. There is no bending mo- 
ment at the two end pins; hence the second derivative of the Spline is zero at the end 
points. Since these end conditions occur naturally in the beam model, the resulting 


curve is known as the 1C1z1QL cUDic SP1172e. The pins, ie the data points, are called 
the [1of ofthe spline. 


Figure 3.7. Cubic spline. 








Figure 3.7 shows a cubic spline that Spans 1 knots. We use the notation 万 六 100 
for the cubic polynomial that spans the Segment between knots 1 and 十 1. Note 
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that the Spline is a Piecewise cUBic curve，put together from the 刀 一 1 cubics 
万 200, 户 300, jino,alofwhich have different coefticients， 

Ifwe denotethesecond derivative ofthe splineatknotibyi, continuityofsecond 
derivatives requires that 


Ji) 三 大 和 100) 一 碟 (al 
Atthis stage, each [is unknowmn, except for 
际 王 岳 研 0 (3.9) 


The starting point for computing the coefticients of 广 ;+1(0 is the expression for 
J 帮 00, which we know to be linear. Using Lagranges two-point interpolation， we 











i 十 1 
can Write 
100 一 1iCO0 十 CHIEH1OO 
where 
大 一 Xi 大 一 好 
bi0= 一 -= 一 一 
Xi 一 关 计 1 尼 计 1 一 好 
Therefore， 
1( 瑟 三 天 二 币 三 和 ( 契 研 克 ) 
人 1 11 1 十 1 1 
OO 一 (b) 
大 大 一 Xi41 
Integrating twice with respect to we obtain 
1i(X 一 Xi1)3 一 KTC 一季)3 
1O0 = 一 4 一 AD 一 BC 一 如 Ca 


646 一 Xi+Dl) 


where 4andBare constants ofintegration.Thelasttwoterms in Eq. (cl) wouldusually 
be written as CXx 十 也 . BylettingC=A4-BandDD= 一 4x+l+Bxy we end up with 
the terms in Eq. (c,， which are more convenient to use in the computations that 
follow- 

Imposing the condition 万 100) = Ji we get from Eq. (C) 


ii 一 Xi13 
Ci 十 406 一 Xi+1) 三 功 








6(Ci 一 Xi+1) 
Therefore， 
咏 1 
4= d 
6 (Ci 一 Xi+1) (d) 
Similarly 万 D1(CXr1) = JiH1yields 
有 
有 | 人 


让 一 Xi 计 1 6 


3.3 Interpolation with Cubic spline 


Substituting Eqs. (d) and (e) into Eq. (c) results in 











帮 ; 龙 一 Ji 3 
Ham= 忆 [到 区 Ce zs 一 aa 
二 
帮 ; 无 一 好 )3 
| 也- Ce 一 2000 xz (3.10) 

”内 二 

十 其 江 一 XU 一 其 1 一 加 
好 一 兆 计 1 


The second derivatives Ki of the spline at the interior knots are obtained from 
the slope continuity conditions 万 ;00) = 户 D1(00) wherei 一 2,.3, ,有 一 1.Aftera 
little algebra, this resujlts in the Simultaneous equations 


Ki-1(Xi1 一 好 ) 十 210i(Xi1 一 Xi+l) 十 Ki105i 一 Xi 


-6( 2 六 230m1 (G3.11) 
Xi-1 一 Xi 好 一 光 计 1 





Because Eqs. (3.11) have atridiagonal coefGicient matrix, they can be solved econom- 
ically with functions LUdec3 andLUso13 described in Art. 2.4. 

Ifthe datapoints areevenlyspacedatintervals then xi 一 说 三 好 一 Xi+l 三 一 几 
and the Eqs. (3.11) simplify to 





6 5 
1 十 4 十 人 1 一 天 风 -1 二 避 大千 其 疝 ) 二 三 :205 (9.2 


国 SP IneCurV 





The first stage of cubic spline interpolation is to set UP Eqs. (3.11) and solve them 
for the unknown ks (recall that Fl = 恬 = 0).This task is carried out by the function 


SPD]ineCuTrvV': 


function K = SplineCurvCxData,yData) 

% Returns curvatures of a cubic spline at the knots ， 
% USAGE: kK = SplineCurvCxData,yData) 

% xData = X-Ccoordinates of data points . 


”% YData = Y-coordinates of data points . 


Dn = lengthCxData) ; 


C = Zeros(Cn-1,1); d 


ones(n,1); 
e = Zeros(Cn-1,1); KK = Zeros(Cn,1); 
cC(1L:n-2) = XData(C1:n-2) - XData(2:n-1L) ; 


d(2:n-1) = 2*(XData(C1L:n-2) - XData(3:n)) ; 
e(2:n-1) = XData(C2:n-1) - XData(3:n) ; 
K(C2:n-1) = 6*(yData(1:n-2) - yYData(2:n-1))... 


./(XData(C1L:n-2) - XData(2:n-1))... 
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- 6*(yData(2:n-1) - yData(3:n))..， 
./(CxData(2:n-1) - xData(3:n)) ; 
[c,dq,e] = LUdqec3(Cc,d,e); 
Kk = LUsol3(Cc,d,e,K) ; 


国 SP ImneEval 





The function spJineEval computes the interpolant at x from Eq. (3.10). The sub- 
function findSeg fnds the Segment of the spline that contains X by the method 
of bisection. It returns the segment number; that is, the value of the subscript 7 in 
Eq, C,10)， 


function Y = SplineEvalLl(CxData,yData,K,X) 

% Returns value of cubic spline interpolant at 又 ， 
% USAGE: YY = SplineEval(xData,yData,K,X) 

% xData = X-Ccoordinates of data pojints . 

% YData = Yy-coordinates of data pojints . 

% 开 = CuUrvatures of spline at the kknots ; 


% Teturned by function spJineCurv . 


工 = findSeg(CxData,X) ; 

Ph = XData(I) - XData(CI+1L) ; 

Y= ((XxX - XData(i+1L)) 3/nh - (X - XData(CiI+1L))x*h)x*xKkCI)VX6.0... 
- ((xX - XData(I)) 3[nh - (CX - XData(CI))x*h)x*kCi+1)/6.0... 
+ YData(I)*(xX - XData(iI+1))Xh... 
- YData(i+1L)*(xX - XData(I) )Xhi 


function 工 = findSeg(CxData,X) 
% Returns :index of segment contalinjing X. 
ILeft = 1; 1IRight = LengthCxData) ; 
while 工 
IfE(CiLRight - Left) <= 工 


工 = 1ILeft;i Teturn 


研 = fix((iLeft + 夺 Right7/V27) ; 
If X < XData(CI) 
IIRiIght = 工 ; 
ese 
王 忆 在 证 三 下 
end 


end 
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EXAMPLE 3.5 
Use natural cubic spline to determine y atx = 1.5.The data points are 





xj|l1l12|13|14|5 
ylol1lolallo 
































solution The five knots are equally spaced at 天 = 1.Recalling thatthe second deriva- 
tiveofanatural splineis zeroatthefirstandlastknot wehaveKl = [5 = 0.Thesecond 
derivatives at the other knots are obtained from Eq. (3.12). Usingi = 2,3,4we getthe 
Simultaneous equations 


0 十 4kz 十 Ka 一 6[0 一 2G) 十 0] = 一 12 





[2 十 4ks 十 K4 王 6[1 一 2(00) 十 ]=12 





Ka 十 4k4 十 0=6[0 一 20) 十 0] = 一 12 


The solution is K2> = [4 = 一 30/7, [3 = 3617. 

The pointx = 1.5 lies in the segment between knots 1 and 2. The corresponding 
interpolantis obtained from Eq. (3.10) by settingi = 1. With Xi 一 Xi+l = 一 六 = 一 1 we 
obtain 





于 夺 
有 廊 200 = 上 [ec 一 xz 一 一切 ] 十 二 [一 2 一 一切] 





[JJ1Cx 一 X2) 一 JJ2(X 一 XI)] 


Therefore， 








705= 205=o+ 让 ( 了 )[Qaa 1D)3-(5-D]-I0-10.5-ID]= 0.7679 


The plot of the interpolant which in this case is made up of four cubic segments, is 
Shown in the figure. 

















| [ 

上 上 上 

上 中 中 

上 上 上 

| | | 上 | | | 上 | 
1.00 1350 2.00 2.350 3.00 3.30 4.00 4.30 3.00 


大 
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EXAMPLE 3.6 

Sometimes it is preferable to replace one or both of the end conditions of the cu- 
bic spline with something other than the natural conditions. Use the end condition 
户 2(0) = 0 (Zero slope),ratherthan 亨 2(0) = 0(zero curvature),to determinethe cubic 
Spline interpolant atX 一 2.6based on the data points 





0|1| 2 13 
yl11110510 





























solution WemustfirstmodifyEqs.(3.12) to accountforthenewendcondition. Setting 
1 一 1 in Eq. (3.10) and differentiating, we get 


三 2 三 
(X1 癌 2 语 ， (X1 问 |+ 于 二 交 


6 X1 一 兆 2 光 ] 一 兆 2 


(一 X2)2 
X1 一 X2 





向 
hm= 电 | 


Thus the end condition 万 (xl) = 0yields 





奢 矿 一 
人 
马 6 光 1 一 光 2 
OT 
近 一 所 
28 [2 一 一 6 一 一 
人 RS 


From the given data we see that yl = ]J2 = 1 sothatthe last equation becomes 
2K1i 十 Ki 一 0 (al 


The other equations in Eq. (3.12) are unchanged. Noting that [4 = 0 and 灵 = 1 we 
have 


Ki 十 4k2 十 Kas 王 6[1 一 2(0) 十 0.5] = 一 3 (b) 
K[2 十 4ks3 一 6[1 一 2(0.5) 二 0]=0 (C) 


The solution ofEqs. (a)-(c) is Ki = 0.4615, [2 = 一 0.9231,， ks = 0.2308. 
The interpolant can now be evaluated from Eq. (3.10). Substituting = 3 and 
Xi 一 Xi+l 三 一 1], weobtain 





夺 于 
有 户 400 = 二 [-C =-xo03+ 一 区 ] [--Cc- xsa)3+ (一 xs)] 
一 Ja 一 XZ4) 十 J4x 一 X3) 


Therefore， 


0.2308 
]J(2.6) = 方 4(2.6) = 





[0.9 + (-0.4]+0 一 0.5(-0.90 二 0= 0.1871 
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EXAMPLE 3.7 


Write a prIogram that interpolates between given data points with the natural cubic 
Spline. The program mustbe able to evaluate the interpolantfor more than one value 
of x. As atest use data points specified in Example 3.4 and compute the interpolant 
atx 王 1.5andx=4.5 (dueto symmetry these values should be equal). 


solution The program below prompts for xi; it is terminated by pressing the “Teturn” 


key. 


% Example 3.7 (Cubic spline) 
[1; 2; 3; 4; 5]; 
Datar LO 工科 0 工 3 013 

k = SplLineCurvCxData,yDatal) ; 
while 工 


区 三 卫生 U 二 人 全 了 


XData 


if isempty(Cx) 
fprintf(' Done '); break 


end 


Y = SPD1LineEvalL(CxXData,yData,K,X) 


fprintf(' An D) 


end 


Running the program produces the following results: 


X = 工 .95 

Y = 王 
0.7679 

X = 4.5 

Y = 王 
0.7679 

芝 至 

Domne 


PROBLEM SET 3.1 





1.， Given the data points 





天 一 1.2 


0.3 


下 江 





5.61 














】 5.76 








3.69 





determineyatx=0using (al Neviles method and (b) Lagranges method. 





122 | Interpolation and Curve Fitting 


2. Find the zero of y(x) from the following data: 





大 0 0.5 1 1.5 之 2.5 3 
) | 1.8421 | 2.4694 | 2.4921 | 1.9047 | 0.8509 | 一 0.4112 | 一 1.5727 






































Use Lagranges interpolation over (aj three; and (bj four nearest-neighbor data 
points. 瑟 1 after finishing part (aj, part (b) can be computed with a relatively 
Small effort. 


3. Thefunction y(z%) representedbythe datain Prob.2hasamaximum atx 一 0.7679. 
Compnute this maximum by Nevilles interpolation over four nearest-neighbor 
data points. 


4. Use Nevilles methodto computey atx=/4from the data points 





到 0 0.5 工 1.5 2 
| -1.00 | 1.75 | 4.00 | 5.75 | 7.00 
































5.， Given the data 





区 0 0.5 工 5 2 
] | 一 0.7854 | 0.6529 | 1.7390 | 2.2071 | 1.9425 
































fndyatx=/4andatr/2. Use the method that you consider to be most con- 
Vvenient， 


6. The points 





zj-211|4|-1|3| -4 
y| -1|12159| 4|24| -53 



































lie on apolynomial. Use the divided difference table of Newtons method to de- 
termine the degree ofthe polynomial. 


7. Use Newtons method to find the expression for the lowest-order polynomial that 
fits the following points: 
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8. 


10. 


了 1 


] 2 


13. 


Use Neviles method to determine the equation of the quadratic that passes 
through the points 





xz-1l 1 3 
了 | 17 | -7 | -15 


























The density of air o varies with elevation 户 in the following manner: 





六 (km) 0 3 6 
Oo (kg/m3) | 1.225 | 0.905 | 0.652 


























Express po(m as a quadratic function using Lagranges method. 


Determine the natural cubic spline that passes through the data points 





xlol1l2 
ylol211 


























Note thatthe interpolant consists oftwo cubics, one valid in 0 < x < 1l, the other 
in1<Xx<2.Verify that these cubics have the same first and second derivatives 
atX 三 1 


Given the data points 





xl1|12|1314|5 
y|131315|112|19|13 
































determine the natural cubic spline interpolant at x = 3.4. 


Compute the zero of the function y(z) from the following data: 





艺 0 0.4 0.6 0.8 1.0 
外 1.150 | 0.855 | 0.377 | 一 0.266 | 一 1.049 
































Use inverse interpolation with the natural cubic spline. 矶 7 Teorder the data so 
that the values of y are in ascending order. 


Solve Example 3.6 with a cubic spline that has constant second derivatives within 
its first and last segments (the end segments are parabolic). The end conditions 
forthis spline are Fl = Ko and 6 1 = 乒 . 
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14. 


15， 


16. 


下 让 


18. 


19， 


国 Write a computer pIogram for interpolation by Nevilles method. The program 
mustbe ableto computethe interpolant at several user-specified values of x. Test 
the program by determiningy atx= 1.1 1.2 and1.3 from the folowing data: 





一 2.0 一 0.1 皇 二 .5 0.5 
2.2796 | 1.0025 | 1.6467 | 1.0635 











一 0.6 肥 昌 1.0 1.8 
1.0920 | 2.6291 | 1.2661 | 1.9896 


























| 咱 有 | 汪 





(Answer:]y = 1.3262, 1.3938, 1.4693) 


国 The speciftic heat cp ofaluminum depends on temperature T as follows:“ 





了 CO) 250 200 100 0 100 300 
cp (JJ/kg.R | 0.0163 | 0.318 | 0.699 | 0.870 | 0.941 | 1.04 






































Determine cp at 了 = 200"C and 400?C. 
国 Find )' atx 一 0.46 from the data 





或 0 0.0204 | 0.1055 | 0.241 | 0.582 | 0.712 | 0.981 
] |‖ 0.385 1.04 二 .79 203 4.39 4.99 527 






































国 The table shows the drag coeffhicient cb of a Sphere as a function of Reynolds 
number Re.5 Use natural cubic spline to find cp at Re = 5, 50, 500 and 5000. 瑟 77 
use log-log scale. 





Re | 0.2 包 20 200 2000 | 20000 
cpD | 103 | 13.9 1 2.72 | 0.800 | 0.401 | 0.433 



































国 Solve Prob. 17 using a polynomial interpolant intersecting four nearest- 
neighbor data points. 


国 The kinematic viscosity /kx of water varies with temperature 了 in the following 
Imanner: 


4 Source: Black, Z.B., and Hartley J.G., 7T7Per7zodjy7za112tcs Harper & Row, 1985. 
5 Source: Kreith, RE, Primciples of Feat Transfen Harper& Row 1973. 
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3.4 





了 (CC) 0 21.1 | 37.8 54.4 | 71.1 87.8 100 
Mu (10-3 m2/s) | 1.79 | 1.13 | 0.696 | 0.519 | 0.338 | 0.321 | 0.296 






































Interpolate /kx at 了 工 = 10",30",60” and 90?C. 


20. 国 The table shows how the relative density o of air varies with altitude 六 Deter- 
mine the relative density of air at 10.5 km. 





六 (km) | 0 | 1.525 3.050 4.575 6.10 7.625 9.150 
0 1 | 0.8617 | 0.7385 | 0.6292 | 0.5328 | 0.4481 | 0.3741 






































Least-Sdquares Fit 
Overview 


Ithe data are obtained from experiments,theytypically contain a significant amount 
of random noise due to measurement errors. The task of curve fitting is to find a 
smooth curve that fits the data points“on the average.” This curve Should have a 
Simple form (e.g. alow-order polynomial, so as to not reproduce the noise. 

Let 


7 了 = 7002 0 


be the function that is to be fitted to the 17. data points (xi Ji 工 = 1,2,..., 7. The 
notation implies that we have a function of x that contains the parameters 人 


J = 1,2,...,m where 1 < 1. The form of jFoo is determined beforehand，usually 
from the theory associated with the exzperiment from which the data is obtained. The 
onlymeans ofadjustingthefitistheparameters.Forexample,ifthe datarepresentthe 
displacements jy ofan overdampedmass-spring system attime tthetheorySuggests 
the choice F0D = aite 2. Thus curve fitting consists oftwo steps: choosing the form 
of joo, followed by computation of the parameters that produce the best fit to the 
data. 

This brings us to the question: whatis meantby “best " fit? 玉 thenoise is confined 
to the -coordinate, the most commonly used measure is the /east-s9qUaTes ji which 


Iminimizes the function 
隐 


Sa2 网 一 >》 [一 Fo] (3.13) 
i1 
with respect to each 0j. Therefore, the optimal values of the parameters are given by 
the solution of the equations 
09 


三 0 大 三 工作 7 (3.14) 
0CK 
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The terms 六 三 下 一 /0G) ip Eq. (3.13) are called 7esiduals; they Tepresent the dis- 
crepancy between the data points and the fitting function at xi. The function 9 to be 
minimized is thus the sum ofthe squares ofthe residuals. Equations (3.14) are generT- 
alynonlinear in oj andmay thus be difficult to solve. Ithe fitting function is chosen 
asalinear combination of speciftied functions 方 (0: 


0 =01I 万 OO 十 G2 户 0 十 … 十 加 ( 轨 


thenEqs. (3.14) arelinear.Atypical exzampleisapolynomialwhere 亡 (x) = 卫 户 (00 三 力 
户 00 = Xetc. 

The spread of the data about the fitting curve is quantified by the st272CaT7 devr- 
G1io1, defined as 


9 
及 一 71 


(3.15) 


一 





Note that 让 刀 = 1710 we have iie1Ppojiatio1 not curve fitting. In that case, both the 
numerator and the denominator in Eq. (3.15) are zero, So that co is meaningless, as 让 
should be. 


Fitting a Straight Line 
Fitting a straight line 

JJ =CTBDX (3.16) 
to data is also known as /iea7r 7e87essio1. In this case the function to be minimized is 


S(a, 人 四 = 六 (太一 @ 一 Bi) 
1 


Equations (3.14) now become 





一 》、 205 一 4 oz 羡 w+ 过 可 -。 
1 1 1 
0 忌 





有 二 之， 2(Ji 一 0 oo 2 人 关 s+s+ 吉 -。 
i1 记 1 记 1 


1 一 1 


Dividing both equations by27and rearranging terms, we get 
_ 1 . 民 5 和 和 二 运 
Q 十 友 一 了 CQX 十 了 二》 如 及 一 了》 和] 
7 1 
where 


护 (3.17) 
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are the mean values ofthexandy data. The solution for the parameters is 


_ 了 2 验 一 2 二 
六 和 好 一 7 2 一 1 姑 





0 (3.18) 


Theseexpressions are susceptibletoroundofferrors (thetwotermsin eachnumerator 

as well as in each denominator can be roughly equal. It is better to compute the 
parameters from 

>》 仿 ( 邓 一 习 

06 一 司 

which are equivalent to Eqs. (3.18), but much less affected by rounding of 寻 . 





4 = 了 了 一动 (3.19) 


Fitting Linear Forms 


Consider the least-squares fit of the 1772eC7jo777 


1I1 
jg0 = QI 及 00 十 Go 户 00 十 十 Gopj0 三 为 万 O0 (3.20) 
姜 1 
whereeach 方 oO isapredeterminedfunction ofx, calleda paszsjzctiom.Substitution 
into Eq. (3.13) yields 


?7 


7172 2 
S= 区 一 >》， o1m| (9) 
邱 


=1 
Thus Eqs. (3.14) are 
95S 到 17 
2 和 区 一 袜 opoo| ho 一 0， 大 = 1 2,. .71 
人 记 1 疡 1 
Droppingthe constant (-2) and interchanging the order of summation, we get 
7172 


2 | Jo 太一 》 记 CJJ， 大 = 1 2 710 
1 一 1 计 1 


j=1 
In matrix notation these eduations are 
Aa =b (3.21al) 


where 
4 一 方 Co) 六 Co 用 一 大 (006) 芒 (3.21b) 
汉 1 il 


Equations (3.21aj, known as the 1o17Cl1 eqguatio1s of the least-squares fit， can be 
Solved with any of the methods discussed in Chapter 2. Note that the coefhicient 
matrix is symmetric ie Ai 三 Ai 
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Polynomial Fit 


Acommonlyusedlinearformisapolynomial. Ifthe degreeofthepolynomialis 7 一 |， 
we have Fo = 六 ;QiXi 1. Here thebasis functions are 


万 00 = X71 了 = 12, ,71 (3.22) 


So thatEqs. (3.21b) become 


OFT 
刀 > 1 2 》J 
开交 2 龙 入 
A= | : 站 b=|: (3.23) 
开矿 :三 闵 工 稚 ， 工 订 zy 


where ystandsfory .Thenormalequationsbecomeprogressively 刘 -conditioned 
with increasing 1 Fortunately this is of little practical consequence, because only 
low-order polynomials are useful in curve fitting. Polynomials of high order are not 
Iecommended, because theytend to reproduce the noise inherent in the data. 


国 Do]LYnF]It 


The function polynFit computes the coefficients ofa polynomial of degree 1 一 1 to 
ft 2 data points in the least-squares Sense. Io facilitate computations, the terms 力 
0 和 5 2 that make up the coeffGicient matrix A in Eq. (3.23) are first 
stored in the vector s and then inserted into A. The normal equations are Solved for 
the coeft8icient vector coeff by Gauss elimination with pivoting. Since the elements 
of coeff emerging from the solution are not arranged in the usual order (the coe 侍 - 
cient ofthe highestpower ofxfirstb,the coeff arrayis fipped” upside-down before 
Ieturning to the calling program， 


function coeff = polynEFit(CxData,yData,m) 

% Returns the coefficients of the Polynomial 

% a(C1L)*x ”CCm-1) + a(C2)*x (CCm-2) + ... 二 am) 

% that fits the dqata polints in the Jeast squares sense . 
% USAGE : coeff = PolynFitCxData,yData,m) 

% xData = X-Ccoordinates of data pojints ， 


% YData = Yy-coordinates of data pojints ， 
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A = Zeros(m); b = zeros(m,1); s = Zeros(2x*m-1,1) ; 
for 工 = 1:1lengthCxXxData) 
temp = YData(I) ; 
于 OF 了 :三 工 : 下 
b(J) = b(GJ) + temp ; 
temp = tempx*xData(CI) ; 


s(j) = s(CJ) + temp ; 
temp = tempx*xXxData(CI) ; 


emnd 
for 工 = 工 :m 

芋 O 了 -三 开 和 

A(CI,J) = SCi+J-I) ; 

end 
emnd 
% Rearrange coefficients So that _ coefficient 
% of X (CCm-1) IIS first 
coefft = fl1ipdim(CgaussPivCA,b) ,1); 


国 St 七 dDeV 


After the coefficients of the fitting polynomial have been obtained, the standard de- 
viation co can be computed with the function stdDev. The polynomial evaluation ip 
stdDevis carriedoutbythesubfunctionpolyEval which is describedin Art. 4.7 一 See 
Eq. (4.10). 


function siIgma = stdDev(Ccoeff ,xData,yData) 

% Returns the standard devliation between data 
% pojints and the Polynomial 

% a(CL)*x ~ (Cm-1) + a(C2)x*x (m-2) + ... + a(Cm) 

% USAGE : sigma = stdDev(Ccoeff ,xData,yData) 

% coeff = _ coefficients of the polynomial . 

% xData = X-Ccoordinates of data points . 


% YData = Y-coordinates of data points . 


m = lengthCcoeff); nn = lengthCxData) ; 
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SIgma = 0 
于 GE 二 二 芷 :下 
Y = polyEval(Ccoeff ,xData(I) ) ; 


SIgma = Sigma + (yData(I) - Y) 2; 
end 


SIgma =Sdqrt(sigma/ACn - my)); 


function YY = polLyEval(Ccoeff ,X) 
% Returns the value of the Polynomjial at X， 
m = engthCcoeff) ; 
7Y = Goeftf(1) ; 
for j = 1:m- 工 
YY = yx*X + coeff(J+L) ; 


end 


Weighting of Data 


Thereareoccasionswhen confidenceintheaccuracyofdatavariesfrompointtopoint， 
For example, the instrument taking the measurements may be more Sensitive in a 
certainTange ofdata.Sometimesthe datarepresenttheresults ofseveral experiments， 
each carried outunder different circumstances. Underthese conditions we may want 
to assign a confidence facton or Weigjpb to each data point and minimize the Sum of 
the Squares of the WeigPpied 1esidUaA 产 = 风 [大 一 where Wi are the weights. 
Hence the function to be minimized is 


Si aa 网 一》 [太一 oa] (3.24) 
E1 


This procedure forces the fitting function 2 closer to the data points that have 
higher weights. 


Weighted linear regression 
Ifthe fitting function is the straight line 三 2X) =QT+ px Eq. (3.24) becomes 


用 
S@ 用 =》 TO 一 aa 一 Do (3.25) 
i1 
The conditions for minimizing S are 


33 - -2 》 Ti 一 0 一 Di)=0 
4， 各 1 
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35S 5 
于 = 生肖 W205 一 0 一 po) =0 
OFT 
用 用 用 
Q 关 十 石 》 TIW22 一 六 (3.26al) 
二 1 二 汪 1 
用 也 用 
Q》 TY 和 十 帮 2 一 》 TV 和] (3.26b) 


Dividing Eq. (3.26al by 》 W2 and introducing the zeigjzted averages 


和 Ti 从  W2J1 
Tt 2 





(3.27) 


we obtain 
CQ 一 少 一 奔 (3.28a) 
Substituting Eq. (3.28a) into Eq. (3.26b) and solving for pyields after some algebra 


蕊 1 TWOG 一 胃 


已 一 
世 1 Tri 一 胃 


(3.28b) 





Note that Eqs. (3.28) are similar to Eqs. (3.19) for unweighted data. 


Fitting exponential functions 
Aspecial application of weighted linear regression arises in fitting exponential func- 
tions to data. Consider as an example the fitting function 


Fo0 = ae 


Normally the least-squares fit would lead to equations that are nonlinear in Cand 忆 
But 计 we fit ny ratherthan ]), the problem is transformed to linear regression: fit the 
function 


FoOO=InFoo=Ina+px 


to the datapoints (xn JI= 1,2,...,7.This simplitication comes at apriice: least- 
Squaresfittothelogarithm ofthe dataisnotthesameasleast-squaresfittothe original 
data. The residuals of the logarithmic fit are 





天 三 卫 太 一 有 Oo) 王 了 太一 DZ- 一 Di (3.29a) 


whereas the residuals used in fitting the original data are 





方 二 其 一 Foo) = 六 一 aet (3.29b) 
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This discrepancy can be largely eliminated by weighting the logarithmic ft. We 
note fom Eq. (3.29b) that jn(7 一 力 ) = ln(deo) = lnw+Dxci, so that Eq. (3.29a) can 
be written as 





天 = 了 太一 (7 力 =mll 辣 


了 


Htheresidualsm aresufficientysmall (” << J), wecanusetheapproximation ln(] 一 
户 / 芒 ) s 记 /J] So that 


严 二 万/ 芒 


We can now see that by minimizing 》 R2, we inadvertently introduced the weights 
1/J. This effect can be negated 让 we apply the weights J when fitting 和 (0 to 
(ny,xiithatis, byminimizing 


S= 》] 开 形 (3.30) 
1 一 1 


Other examples that also benefit from the weights W; = Ji are given in Table 3.3. 





























三 0 厂 (20) Data to be fitted by 和 (2 
axex | In[Foo/ 如 =Ina+Bx [xi， IlnO2/2)] 
cx | ln foo =Inza+bnOo (nxzi,iny 
Table 3.3 
EXAMPLE 3.8 


Fit a straight line to the data shown and compute the standard deviation. 





xz |o0110120125|3.0 
y||29|137141144|5.0 
































Solution The averages ofthe data are 








】 .0 十 1.0 十 2.0 十 2. .0 
2 十 工 0 十 0 于 25 寺 3 _17 
5 5 
-1 2.9 十 3.7 十 4.1 十 4.4 十 5.0 
0 5 ee 
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The interceptZandslopepofthe interpolant can nowbe determined from Eq. (3.19): 


六 二 2 一 悦 
0 一 习 
2.9( 一 1.7) 十 3.7( 一 0.7) 十 4.1(0.3) 十 4.4(0.8) 十 5.0(1.3) 
” 0.0 一 1.7) + 1.0(-0.7) 二 2.0(0.3) 十 2.5(0.8) + 3.0(1.3) 
3 
一 一 一 一 0.6431 
5 


Q 一 了 一 X0O=4.02 一 1.7(0.6431) = 2.927 











Therefore, the regression line is 太 2X) = 2.927 二 0.6431x, which is shown in the fgure 
together with the data points. 
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We start the evaluation of the standard deviation by computing the residuals: 





】 2.900 | 3.700 4.100 4.400 | 5.000 
三 0 2.927- 1 .3.570 4.213 4.535 | 4.856 
= oo | -0.027 | 0.130 | -0.113 | -0.135 | 0.144 



































The sum ofthe Squares of the residuals is 


S= >》 [一 oa] 
= (--0.027) 2 十 (0.130)? 十 (一 0.113)2 十 (--0.135)2 二 (0.144)” = 0.06936 


So that the standard deviation in Eq. (3.15) becomes 


.069 
0 一 二 一 0.1520 
九 一 110 5 一 2 
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EXAMPLE 3.9 
Determine the parameters Cand D so that 矿 20 一 Cetx fits the following data in the 
least-squares Sense. 





X | 1.2 2.8 4.3 5.4 6.8 9 
|7.5 | 16.1 | 38.9 |67.0 | 146.6 | 266.2 






































Use two different methods: (1) fitln yi; and (2) fit jn Ji with weights W; = 太 .Compute 
the standard deviation in each case. 


Solution of Part (1) The problem is to fit the function In(dei) = In 十 pxtothe data 





万 工 2.8 4.3 5.4 6.8 乱 9 
2 一 ]ny | 2.015 | 2.779 | 3.661 | 4.205 | 4.988 | 5.584 



































We are now dealing with linear regression，where the parameters to be found are 
4=lnaand 太 Following the steps in Example 3.8, we get (Skipping some of the 
arithmetic details) 


1 工 二 让 
= 2 =4733 2 一 2 五 一 3.872 


xi00 一 为 16.716 
Wi 一 圈 31.153 





一 0.5366 4=5 一 翅 =1.3323 


Therefore,&a= e4 = 3.790 and the fitting function becomes Fo = 3.790e05366. The 
plots of jx and the data points are shown in the fgure. 





















300 | 1 1 
上 
天 

7 (RE 
一 一 
站 
0 | | 5 | 

1 2 3 4 5 0 吕 8 
大 
Here is the computation of standard deviation: 
了 7.50 | 16.10 | 38.90 | 67.00 | 146.60 | 266.20 





太 癌 7.21 | 17.02 | 38.07 | 68.69 | 145.60 | 262.72 
yy 一 oo | 0.29 | -0.92 0.83 | 一 1.69 1.00 3.48 
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S$= >》 [Im - oa] = 17.59 


厅 王 本 一 2.10 
6 一 2 
Aspointed outbefore, this is an approximate solution ofthe statedproblem, since 
we didnotfit ybutlny.Judging bythe plot the fit seems to be good. 


solution of Part (2) We again fit ln(aetz) = lnzZ+apxtoz=hn ]J，but this time the 
weights Wi = Jareused.From Eqs. (3.27) the weighted averages ofthe data are (recall 
thatwefitz=lnJ 


737.5 x 103 


一 7.474 
] 98.67 x 103 


> 





症 Ja 528.2 x 107 


四 = 5.353 
刀 1 98.67x 105 


My 
员 





and Eqs. (3.28) yield for the parameters 


JP?a06 一 站 35.39 x 103 


一 一 = 0.5440 
J2xi06 一 和 65.05 x 103 








Ina= 人 -=5.353 一 0.5440(7.474) 一 1.287 
Therefore， 
Q = em2 = el287 = 3.622 


sothatthe fittingfunction is Fo = 3.622e05440x. As expected, this result is somewhat 
different from that obtained in Part (]). 
The computations of the residuals and standard deviation are as follows: 





了 7.50 | 16.10 | 38.90 | 67.00 | 146.60 | 266.20 
三 0 6.96 | 16.61 | 37.56 | 68.33 | 146.33 | 266.20 
yy 了 一 oo ‖ 0.54 | 一 0.51 1.34 | 一 1.33 0.267 0.00 






































S= >》 [xi- oa] =4186 


9 
由 023 
“一 V6 二 2 
Observe that the residuals and standard deviation are smaller than in Part (1), indi- 
cating a better fit as expected. 


萱 到 Interpolation and Curve Fitting 


It can be shown that fitting Jm directly (which involves the solution of a transcen- 
dentalequation) results in F(x) = 3.614e05442x.The correspondingstandard deviation 
is o = 1.022, which is very close to the result in Part (2). 


EXAMPLE 3.10 

Write a program that fits apolynomial of arbitrary degree Kto the data points showmn 
below. Use the program to determine K that best fits this data in the least-squares 
Sense. 





一 0.04 0.93 1.95 2.90 3.83 | 5.00 
8.66 6.44 4.36 3.27 0.88 | 0.87 

















5.98 7.05 8.21 9.08 | 10.09 
3.31 4.63 6.19 7.40 8.85 
































| 总 





solution The following program prompts for 志 .Execution is terminated by pressing 
“Teturn.” 


% EXxample 3.10 (Polynomial curve fitting) 

xData = [-0.04,0.93,1.95,2.90,3.83,5.0,... 
5.98，72055852159.08,10.09] ”3 

YData = [-8.66,-6.44,-4.36,-3.27,-0.88,0.87,，... 
3.31,4.63,6.19,7.4,8.85] ; 


format Short e 


while 工 

Kk = :input(C'"dqegree of polLlynomial =  ”); 

IfE Isempty(CKy) % Loop Is terminated 
fprintf('Done') % by pressing ”Teturn 
break 

end 


coeff = polLlynFit(CXxData,yData,K+1) 
SIgma = stdDev(Ccoeff ,xData,yData) 
在 阿 荆 主 贡 二 到 6 六 看” 


end 


The results are: 


Degree of polLynomial = 1 工 
Coeff = 
工 .7286e+000 
-7.9453e+000 
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SIgma = 一 
5.1128e-001 


degree of polynomial = 2 
Coeff = 
-4.1971e-002 
2.1512e+000 
-8.5701e+000 
SIgma = 
3.1099e-001 


degree of polynomjial = 3 
coeff = 
-2.9852e-003 
2.8845e-003 
1.9810e+000 
-8.4660e+000 
SIgma = 
3.1948e-001 


degree of polynomial = 


Done 


Because the quadratic 2 = -0.041971x2 十 2.1512x7 一 8.5701 produces the 
smallest standard deviation, it can be considered as the “best' fit to the data. But be 
warned 一 thestandard deviationisnotaninfalliblemeasure ofthe goodness-of-fit.Itis 
alwaysagoodideatoplotthe datapoints and 太 (x) beforefinal determination is made. 
The plot of our data indicates that the quadratic (solid line) is indeed a reasonable 
choice for the fitting function. 
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PROBLEM SET 3.2 





Instructions Plot the datapoints and the fitting function whenever appIopriate. 
1. Showthatthe straightline obtainedbyleast-squaresfit ofunweighted data always 


passes through the point (X, 记 . 


2. Use linear Tegression to find the line that fits the data 





一 5 


1.0 

















y | -1.00 | -0.55 








0.00 | 0.45 








1.00 





and determine the standard deviation. 


3. Three tensile tests were carried out on an aluminum bar. In each test the strain 


was measured at the same values of stress. The results were 





























Stress (MPa) 34.5 | 69.0 | 103.5 | 138.0 
Strain (Jest 1) | 0.46 | 0.95 | 1.48 1.93 
Strain (Jest2) | 0.34 | 1.02 | 1.51 2.09 
Strain (Jest3) | 0.73 | 1.10 | 1.62 [ 靖 区 











wheretheunits ofstrain aremm/m.Uselinearregression to estimatethemodulus 


of elasticity ofthebar (modulus of elasticity = stress/strain). 


4. Solve Prob. 3 assumingthatthe third test was performed on an inferior machine， 


So that its results carry only half the weight ofthe other two tests. 


5. 国 Fit a straight line to the folowing data and compute the standard deviation . 






































这 0 0.5 1 下 5 思 5 
| 3.076 | 2.810 | 2.588 | 2.297 | 1.981 | 1.912 
万 3 3.5 4 4.5 

》 了 | 外 1.653 | 1.478 | 1.399 | 1.018 | 0.794 








6. 国 Thetable displaysthemass Mandaveragefuelconsumptionb ofmotorvehicles 
manufactured by Ford and Honda in 1999. Fit a straight line = 4 十 DM to the 


data and compute the standard deviation , 
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Model M (kg) | y (kmylitenD 
ContouI 1310 10.2 
CIown Victoria | 1810 8.1 
EScort 1175 11.9 
Expedition 2360 5.5 
Explorer 1960 6.8 
EF-150 2020 6.8 
Ranger 1755 尝 
Taurus 1595 8.9 
Accord 1470 9.8 
CR-V 1430 10.2 
Civic 1110 13.2 
Passport 1785 7 














7. 国 The relative density o of air was measured at various altitudes 有 . The results 
Were: 





忆 (km) | 0 | 1.525 3.050 4.575 6.10 7.625 9.150 
DO 1 | 0.8617 | 0.7385 | 0.6292 | 0.5328 | 0.4481 | 0.3741 






































Use aquadratic least-squares fit to determine the relative air density at 球 = 10.5 
km. (This problem was solved by interpolation in Prob. 20, Problem Set 3.1.) 


8. 国 Kinematic viscosity Mk of water varies with temperature as Shown in the 
table. Determine the cubic that best fits the data, and use it to compute Mk at 
了 = 10?, 30", 60",and90?C. (This problem was solvedin Prob. 19, Problem Set 3.1 
by interpolation.) 





了 (GO) 0 21.1 | 37.8 54.4 | 71.1 87.8 100 
Mu (10-3 m2/s) | 1.79 | 1.13 | 0.696 | 0.519 | 0.338 | 0.321 | 0.296 






































9. 国 Fit a straightline and aquadratic to the data 





汪 1.0 2.5 3.5 4.0 下 1.8 甩 吧 3.7 
] | 6.008 | 15.722 | 27.130 | 33.772 | 5.257 | 9.549 | 11.098 | 28.828 









































Which is a better fit? 


140 | Interpolation and Curve Fitting 


10. 国 Thetable displaysthermalefficiencies ofsomeearlysteamengines.6 Determine 
thepolynomialthatprovidesthebestfittothedataanduseittopredictthethermal 
efficiency in the year 2000. 





















































Year 外 Ef6ciency ( 史 ) Type 

1718 0.5 Newcomen 

1767 0.8 9meaton 

1774 1.4 9meaton 

T775 2.7 Watt 

1792 4.5 Watt 

1816 7.5 Woolf compound 
1828 12.0 Improved Cornish 
1834 17.0 Improved Cornish 
1878 17.2 Corliss compound 
1906 23.0 Triple expansion 





11. The table shows the variation of the relative thermal conductivity K of sodium 
with temperature 7. Find the quadratic that fits the data in the least-squares 
Sense. 





了 CC) 49 190 357 524 690 
太 1.00 | 0.932 | 0.839 | 0.759 | 0.693 
































12，Let 矿 0) = Xz be the least-Squares fit of the data (xi Ji 一 12,... ,7 and jlet 
FO=Inz+Dpnxbethe least-squares fit of dtnxi, In y) 一 See Table 3.3. Prove 
that 玉 = 产 /i Where the residuals are 产 三 大 一 jc and 天 = 了 太一 下 (ci). As- 
Sume that 广 天 < 蕊 ， 

13. Determine & andpfor which j 太 2x) = 4asin(rx/2) 十 Dcos(rxX/2) fits the following 
data in the least-squares Sense. 





党 一 0.5 一 0.19 0.02 0.20 0.35 0.50 
]) | 一 3.558 | 一 2.874 | 一 1.995 | 一 1.040 | 一 0.068 | 0.677 



































5 Source: Singer C., Holmyard, E.J, Hall A.R., and Williams, TH., 4 页 story of Tecjzzology Oxford 
University Press, 1958. 
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14. Determine gand pso that 丰 20 三 CXp fits the following data in the least-squares 


二 5， 


16. 


Sense. 





X | 0.5 1.0 1.5 2.0 汪 
) | 0.49 | 1.60 | 3.36 | 6.44 | 10.16 
































Fit the function 太 2) 一 CXebx to the data and compnute the standard deviation . 





大 0.5 1.0 1.5 2.0 人 5 
] | 0.541 | 0.398 | 0.232 | 0.106 | 0.052 
































国 The intensity ofradiation ofaradioactive substance was measured athalf-year 
intervals. The results were: 























1 (yearSs) 0 0.5 1 5 2 2.5 
)/ 1.000 | 0.994 | 0.990 | 0.985 | 0.979 | 0.977 

1 (years) 3 3.5 4 4.5 5 5.5 
7) 0.972 | 0.969 | 0.967 | 0.960 | 0.956 | 0.952 


























where 7 is the relative intensity of radiation. Knowing that radioactivity decays 


exponentially with time: 7 (0 一 ae- estimate the radioactive half-life of the 
Substance. 


IIATLAB Functions 


芯 


= interp1CxData,xData,x,method) returns the value of the interpolant y at 


point x according to the method specified: method = '1linear' Uses linear 
interpolation between adjacent data points (this is the defaulb; method = 
:sbline' carries out cubic spline interpolation. 广 xis an array yis computed 
for all elements of x. 


= polyfit(CxData,yData,m) returnsthecoefficients aofapolynomial ofdegree 


mthat fits the data points in the least-squares Sense. 


= polyval(a,x) evaluates a polynomial defined by its coefficients a at point x. 


I 开 xis an array yis computed for all elements of x. 


= std(x) returnsthestandard deviation oftheelements ofarrayx.Ifxisamatrix， 


s is computed for each column of x. 


xbar = mean(Cx) computes the mean value of the elements of x. 了 xis a matrix， 


xbar is computed for each column of x. 
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Linear forms can be fitted to data by setting up the overdetermined equations in 
Eq. (3.22) 


Ea 一 y 


and solving them with the command a = RNy (recall that for overdetermined equa- 
tions the backslash operatorreturns theleast-squares solution). Hereis an ilustration 
how to fit 


Jo = QI1 十 de 十 G3Xe 


to the data in Example 3.9: 


XData = [1.2; 2.8; 4.3; 5.4; 6.8; 7.0]; 

YData = 上 [757 16 38.93 67.0; 146.6)， 266.2]'!， 
EF = ones(1LengthCxData) ,3); 

F(:,2) = exp(CXxData(:)) ; 

FEF(:,3) = XData(:).x*xexp(-XxData(:)); 

a = FEFNYData 


4 


4.1 





Roots of Equations 


Find the solutions of /oo = 0 where thefunction 太 is given 


Introduction 


Acommonproblem encounteredin engineering analysis is this: givenafunction 矿 20)， 
determine thevalues ofxfor which 太 x) = 0.The solutions (values of xz) are known as 
the roof ofthe equation 太 2) = 0 orthe zeroes ofthe function 三 20). 

Before proceedingfurther it mightbe helpful to reviewthe concept of a ji72ctio7. 
The equation 


]y = J00 


containsthreeelements:aninputvaluex, anoutputvaluey andtherule 太 forcompnut- 
ing].Thefunction is saidto be givenittherule 太 is specified. mnumerical computing 
therule is invariably a computer algorithm. Itmay be afunction statement Such as 


J(x] = cosh(x) cos(O0 一 1】 


or a complex procedure containing hundreds or thousands of lines of code. As long 
as the algorithm produces an outputy for each input xz, it dualifties as a function. 

The roots of equations may be real or complex. The complex roots are seldom 
computed, sincetheyrarelyhavephysical significance.An exceptionisthepolynomial 
equation 


CIX2 十 GoX 1 十 .十 Ci 二 Cl=0 


where the complexroots maybe meaningful (as in the analysis ofdampedvibrations， 
for example). For the time being, we will concentrate on finding the real roots of 
equations. Complex zeroes of polynomials are treated near the end of this chapter. 
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4.2 


In general an equation may have any number of (real) roots, or no Ioots at all. 
FEor example， 


SinX 一 X 一 0 
has asingle root namelyx 一 0, whereas 
tanX 一 X 一 0 


has an infinite number ofroots (X = 0, 士 4.493, 士 7.725, .. .). 

All methods offndingroots are iterative procedures thatrequire a starting point， 
jie, an estimate of the root. This estimate can be crucial; a bad starting value may 
fail to converge, or imay converge to the “wrong "root (aroot different from the one 
Soughtb.Thereisno universalrecipeforestimatingthevalue ofaroot.Iftheequation is 
asSociated withaphysical problem, then the context ofthe problem (physical insighb 
might suggest the approximate location ofthe root. Otherwise, the function must be 
plotted, or a Systematic numerical search for the roots can be carried out. One such 
Search method is described in the next article. 

Itis highly advisable to go astep further and Dirackettheroot (determine its lower 
and upper bounds) before passing the problem to a root-finding algorithm. Prior 
bracketing is, in fact mandatory in the methods described in this chapter. 


Incremental Search Method 


The approximate locations ofthe roots are best determined by plotting the function, 
Oftenaveryroughplotbasedonafewpoints,is sufficientto giveusreasonable starting 
values.Anotherusefultoolfor detectingandbracketingrootsistheincrementalsearch 
method. It can also be adapted for computing roots, but the effort would not be 
worthwhile, since other methods described in this chapter are more efficient for that. 
The basic idea behind the incremental search method is simple: 让 Foxc and 
J (xz) have opposite signs, then there is at least one Ioot in the interval (xl, xz). Ifthe 
intervalis small enough, itis likelyto contain asingle root. Thus the zeroes of /让 x) can 
be detected byevaluating the function at intervals Ax andlooking for change in sign. 
There are Several potential problems with the incremental search method: 


。 Itis possible to miss two closely spaced roots 让 the search increment Axis larger 
than the spacing ofthe roots. 

。 A double root (two roots that coincide) will not be detected. 

。 _ Certain singularities of 帮 x) can be mistaken for roots. For exzample， 太 2x) = tanx 
changes Sign at X 一 士 二 7127， 九 一 1,3,5,...，as Shown in Fig. 4.1. However these 
locations are nottrue zeroes, Since the function does not cross the X-axis. 


145 | 4.2 Incremental Search Method 


10.0 





3.0 


0.0 


Figure 4.1. Plot of tan X. 
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国 Oootsearch 


The function rootsearch looks for a zero of the function 太 oo in the interval (a,b). 
The search starts at a and proceeds in steps dqx toward b. Once a zero is detected， 
zootsearch returns its bounds (xl1,x2)] to the calling program. Ia root was not 
detected, xl1 = x2 = NaN is returned (in MAILAB NaN stands for not a number”). 
After the first root (the root closest to a) has been bracketed, rootseazrch can be 
called again with a replaced byx2 in order to find the nextIroot. This can be repeated 
as ]ong as rootsearch detects aroot. 


function [x1L,xXx2] = rootsearchCfunc,a,b,dqx) 
% Incremental search for a root of 工 (X) . 
% USAGE : [xl1,x2] = TootsearchCfunc,a,d,dqx) 


% INPUT : 

% func = handle of function that Teturns ECXxX) . 

% ab = 1imits of search . 

% qdX = Search :Increment . 

% OUTPUT : 

% X1,X2 = bounds on the smallest root in (Ca,b); 

% Set to NaN If no Toot was detected 
误 二 三: 志 。 f1 = fevalCfunc ,X1) ; 


X2 = ar+dxi ffE2 
while fl*f2 > 0.0 
IE xl1 >= b 
X1L = NaN;i X2 


feval(Cfunc ,X2) ; 


NaN ; Yeturn 


end 
X1 = X2; 二 站 深 汗 223 
X2 = XL + dqx; f2 = feval(Cfunc,X2) ; 


end 
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4.3 


EXAMPLE 4.1 
Use inpcremental Search with Ax= 0.2 to bracket the Smallest positive Zero of 
了 ( 三 广 3 一 1022 二 5: 


solution We evaluate Fo at intervals Ax = 0.2, staring atXY = 0, until the function 
changes its sign (value of the function is ofno interest to Us; only its sign is relevant). 
This procedure yields the following results: 





























X J OO 
0.0 | 5.000 
0.2 | 4.608 
0.4 | 3.464 
0.6 | 1.616 
0.8 | 一 0.888 





From the sign change ofthe function we conclude that the smallest positive zero lies 
betweenx = 0.6andx=0.8. 


Method of Bisection 


Afteraroot of 帮 x) = 0has beenbracketedin the interval (2 , z2), Severalmethods can 
be used to close in on it. The method of bisection accomplishes this by successively 
halving the interval until it becomes sufhiciently small. This technique is also known 
as the ;11e7VCL PC11708 11e 态 od. Bisection is notthe fastestmethod available for com- 
putingroots,butitis the mostreliable. Once aroothas been bracketed, bisection will 
always close in on it. 

Themethod ofbisection uses the same principle as incremental search: 计 there is 
arootin the interval (xl, xz)j, then 太 xl .xz) < 0.In order to halve the interval we 
compute 让 xaj, where z 一 (xl 十 X2jisthemidpoint oftheinterval.I 帮 (xz) .7 太 xs) < 
0, then therootmustbe in (xz, Xs) and we recordthis byreplacing the original bound 
Xl byxXas. Otherwise, the rootjlies in (xl, Xa), in which case xz is replaced byxs. In either 
case, the new interval (xl, xz) is halfthe size ofthe original interval. The bisection is 
Iepeated until the interval has been reduced to asmall value s, So that 


| 好 一 疝 | 和 8 


It is easy to compute the number of bisections required to reach a prescribed 
s. The original interval Ax is reduced to Ax/2 after one bisection，Ax/22 after 
two bisections and after 7 bisections it i AX/2”. Setting AxX/2 "=s and solving 


4.3 Method of Bisection 


for 1 we get 


In(Axl/s) 
ln2 ee 


国 Disect 


This function uses the method of bisection to compute the root of 太 oo = 0 that is 
known to lie in the interval (x1,x2). The number ofbisections n required to reduce 
the interval to tol is computed from Eq. (4.1). The input argument filtez COntrols 
the fltering of suspected Singularities. By setting filter = 1, we force the routine 
to check whetherthemagnitude of /xz decreases with each intervalhalving. Ifit does 
not the "root maynotbearootatal butasingularity in which case root = NaN is 
returned. Since this feature is not always desirable, the default value is filter = 0. 


function root = bisect(Cfunc,XL,X2 ,filter,tol) 
% Finds a bracketed zero of f(x) by bisection . 
% USAGE : Toot = bisect(Cfunc,X1L,X2,filter,tol) 


% INPUT : 
% func = handle of function that Teturns 工 (X) . 
% X1,x2 = 1Limits on interval contalining the Toot.， 


% filter = Singularity filter: 0 = off (qdqefault)，1 = on. 


% 七 DJ = _ error tolerance (qdqefault is 1.0e4*eps) . 
% OUTPUT : 
% Toot = Zero of f(x)，or NaN If singularity Suspected . 


If nargin < 5; tol = 1.0e4x*eps; end 
If narglin < 4; filter = 0; end 
f1 = fevalCfunc,X1) ; 


If fl == 0.0; Froot = XL;i Peturni end 
f2 = fevalCfunc,X2) ; 
If f2 == 0.0; Toot = X2; Teturni end 


王 下 渤 于 玉 芋 2 区 0 


erTror( "Root Is Phot bracketed in (xX1,X2) ) 


Dn = celiIl(lLog(Cabs(CxXx2 - X1L)/Xtol)/Log(2.0)); 

for 工 = 工 :mn 

0.5*(X1 + X2) 

f3 = feval(Cfunc,X3) ; 

IfCfilter == 1) & (Cabs(Cf3) > abs(Cf1))... 
& (abs(Cf3) > abs(Cf2)) 


愉 
Cn 
中 
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Toot = NaN;i Yeturn 
emnd 
If f3 == 0.0 
Foot = X3; Feturn 
emnd 
二 站 二 2 于 3 50 
广 业 三- 区 3 二 二 三 符 33 
else 
入 2 三 区 3 二 2. 三 竺 33 
emnd 
end 
Toot=(X1 二 X2)/2; 


EXAMPLE 4.2 
Use bisection to find the root of Foo =x 妈 -10x2+5=0thatlies in the interval 
(0.6, 0.8). 


solution Thebestwayto implementthemethodistousethetable shownbelow. Note 
that the interval to be bisected is determined by the sign of /0, notits magnitude. 












































范 J 太 2x) Interval 
0.6 1.616 一 
0.8 一 0.888 (0.6, 0.8) 
(0.6 十 0.8)/2 = 0.7 0.443 (0.7, 0.8) 
(0.8 十 0.7)/2 = 0.75 一 0.203 (0.7, 0.75) 
(0.7 十 0.75)/2 = 0.725 0.125 (0.725, 0.75) 
(0.75 十 0.725)/2 = 0.7375 一 0.038 (0.725, 0.7375) 
(0.725 十 0.7375)/2 = 0.73125 0.044 | (0.7375, 0.73125) 
(0.7375 十 0.73125)/2 = 0.73438 0.003 | (0.7375, 0.73438) 
(0.7375 十 0.73438)/2 = 0.73594 一 0.017 | (0.73438, 0.73594) 
(0.73438 + 0.73594)/2 = 0.73516 | -0.007 | (0.73438, 0.73516) 
(0.73438 + 0.73516)/2 = 0.73477 | 一 0.002 | (0.73438, 0.73477) 
(0.73438 二 0.73477)/2 = 0.73458 0.000 一 














The final result x = 0.7346 is correct within four decimal places. 
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EXAMPLE 4.3 
Findaithezeroesof /Fox =X=tanxintheinterval(0,20)bythemethodofbisection . 
Utilize the functions rootsearch andbisect. 


solution Notethattan xis singularand changes sign atx = 垃 /2,3r/2,....Toprevent 
bisectfrommistakingthesepointforroots,wesetfiltezr 一 1.Ihecloseness ofroots 
to the singularities is another potential problem that can be alleviated byusing small 
Axin rootsearch. Choosing Ax= 0.01 we arrive at the following program: 


% EXample 4.3 (root finding with bisection) 
a = .0.07 D = 20.03 0x 三 0.01; 
Droots = 0 
while 工 
[X1,x2] = zootsearchCaQfex4_3,a,b,dqx) ; 
If Isnan(CxL) 
break 
ese 
豆 -三 文 2 
bisect(CQfex4_3,X1L,Xx2 ,1) ; 


If ”Isnan(XxX) 


Droots = Droots 二 工 ; 
玉 站 G 七 (三 训 忆 二 丰 ) 三 -有 
end 
end 
end 


OO 


Recall that in MAILAB the Symbol Q before afunction name creates a PC11dlje for 
the function. Thus the input argument @fex4_3 in Yootsearch is a handle for the 
function fex4-3 listed below 


function Yy = fex4_3(XxX) 
% Function used :in Example4.3 


yY=X- tan(Xx); 
Running the program resulted in the output 


>> Toot = 
0 4.4934 757253 10.9041 14.0662 17.2208 
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4.4 


Brent's Miethod 


Brents method”combines bisection and quadratic interpolation into an efficient 
Ioot-fnding algorithm. In most problems the method is much faster than bisection 
alone,butit can become sluggish iftthe function is notsmooth.Itis therecommended 
method of root finding 计 the derivative of the function is diftfticult or impossible to 
compnute. 
























1 一 Old interval -一 1 Old interval 
-New -New 
interval | interval 
| Xs | 
有 本 
(a) Case of X<Xs (b) Case of X> Xs 


Figure 4.2. Inverse quadratic iteration . 


Brents method assumes that a root of jx) = 0 has been initially bracketed in 
the interval (xi, z2). The root-finding process starts with a bisection step that halves 
the interval to either (x, x] or (0 , 和 ) where 交 = (00 十 好)/2, asshown in Figs.4.2(a) 
and (b). In the course of bisection we had to compnute 及 = Jo), 户 = jeo) and 
广 = jj, so that we now know three points on the jx curve (the open circles in 
the fgure). These points allow us to carry out the next iteration of the root by 172Ve7se 
GUId1atic 1101e1Ppolatio1 (Viewingxas aquadratic function of 廊 ). Ithe resultxofthe 
interpolation falls inside the latest bracket (as is the case in Figs. 4.2), we accept the 
Iesult. Otherwise, another round of bisection is applied. 


j(X) jx) 











Figure 4.3. Relabeling points after an iteration. 


The next step is to relabel x as 1 and rename the limits of the new interval 
XL and yx (0 < 和 妇 <j), asindicated in Figs. 4.3. We have now recovered the orig- 
inal seduencing of points in Figs. 4.2,but the interval (Xi,X2) containing the root 


”Brent R.P， Aigo7itp1as jpor Mininazizatio7 IUitnout Deriyvatives Prentice-Hall 1973. 
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has been reduced. This completes the first iteration cycle. In the next cycle an- 
other inverse quadratic interpolation is attempted and the process is repeated un- 
til the convergence criterion |X 一 ze| <sis satisffied, where s is a prescribed erToT 
tolerance. 

The inverse quadratic interpolation is carried out with Lagranges three-point 
interpolant described in Art. 3.2. Interchanging the roles ofx and 记 we have 


省 和 了 = 有 
中 -局 Wi- 向 人 吸 - 月 [= 月 需 - 历 -=- 识 
Setting 上 = 0 and simplifying, we obtain for the estimate of the root 


户 户 嫩 ( 大 一 用) 十 户 彤 允 ( 户 一 用 十 矿 户 六 (太一 户 ) 
(太一 户 )( 户 -月 (有 户 一 万 ) 





天 六 三 





区 三 起 三 





The change in the root is 


如 (万 一 户 )( 户 一 户 十 月 十 户 ( 户 -及 ) 十 及 总 ( 户 一 用) 
( 瑚 一 放 ( 户 一 放 ( 瑚 -一方 ) 





AX 一 X 一 如 = 广 (4.2) 





国 DTent 


The function brent listed belowis a simplified version of the algorithm proposed by 
Brent. Itomits some of Brents safeguards against slow convergencei it also Uses a less 
SoOphisticated convergence crTiterion . 


function root = brent(Cfunc,a,b,tol) 

% Finds a toot of fCx) = 0 by combining quadratic 
% :interpolation with bisection (Brent 's method) . 
% USAGE : Toot = brent(Cfunc,a,b,tol) 

% INPUT : 


% func = handle of function that Teturns ECX) . 


% ab = ]1imits of the interval containing the Zoot， 

% tol = error tolerance (qdqefault is 1.0e6*eps) . 

% OUTPUT : 

% root = zero of fxXx) (Croot = NaN If failed to converge) . 


If narglin < 4; tol = 1.0e6*eps; end 
% First step Is bisection 

X1 = aij fl1 = feval(Cfunc,XL) ; 

If fl == 0; Foot = XL;i Feturni end 
X2 = bj f2 = feval(Cfunc,X2) ; 


If f2 == 0; Foot = X2; Teturni end 
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王 丰 :下 二 下 2050 


X3 = 
% Be 


fom 


erTor( "Root Is mnot bracketed :in (人 a,b) ) 


0.5*(a 二 b); 
gilinning of iterative oop . 
二 = 1I:30 


f3 = feval(Cfunc,Xx3) ; 
If abs( 人 f3) < tol 
Foot = X3; Feturn 
emnd 
% Tighten brackets (a,b) on the Toot . 
于 在 生 1 生 3 < 050 iD 三 -过 3 


elsej;i a = X3; 


emnd 

IE (Pb - al) < tolxmax(Cabs(b),1.0) 
Foot = 0.5*(a + b); zeturn 

end 


% TYFY quadratic interpolation . 
denom = (f2 - fl)*(f3 - fl1)*(Cf2 - 3)) 
numez = X3*(f1L - f2)*(f2 - f3 + f1)... 
平生 2 尖 基于 (下 2. 下 3 和 于 注 本 2 人 3 二 于 了 7 
% If division by zero，push xx out of bracket 
% to force bisection . 
If dqenom == 0; GaX = b - ai 
elsej;i dx = f3*numer/denom:; 
end 
和 三 和 3 十 Qxi 
% If Interpolation goes out of bracket，uUse bisection， 
If (b - X)x*(GX - a) < 0.0 
qdX = 0.5x*(b - a);X= a + dx; 
emnd 
% Let X3 <-- X & choose mhnew X1，X2 So that X1 < X3 < X2. 


于 在 - 妆 < 文 3 


广 2 三 X37 汉 2. 三 竺 33 
else 

广 业 三 :区 3 坦 十 三- 生 33 
end 
X3 = X; 
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EXAMPLE 4.4 
Determine the root of Fo =x3 一 10x2+5=0that lies in (0.6,0.8) with Brents 
method. 





solution 
Bisection The starting points are 
Xi 一 0.6 ， 请 =0.63-10(00.6)2 上 +5= 1.616 
如 二 0.8 ， 户 =0.83-10(00.8)2 十 5 一 一 0.888 
Bisection yields the point 
妈 一 07 户 =0.73 一 10(00.7) 2 二 5=0.443 


Byinspectingthesigns of 太 weconcludethatthenewbrackets ontherootare (Xa, 和 2) 一 
(0.7, 0.8). 


First interpolation cycfe Substituting the above values ofx and 太 into the numer- 
ator ofthe quotient in Eq. (4.2), we get 


num 三 鸭 ( 太 一 户 )( 户 一 态 二 用 二 PR( 户 一 及 十 用 ie( 卢 一 廊 ) 
= 0.7(1.616 二 0.888)( 一 0.888 -- 0.443 十 1.616) 
一 0.888(0.6)( 一 0.888 -- 0.443) 十 1.616(0.8)(0.443 -- 1.616) 
= 一 0.30775 





and the denominator becomes 


den = (上 疡 -用 ( 户 一 力 ( 户 一 为) 
= (一 0.888 -- 1.616)(0.443 -- 1.616)( 一 0.888 -- 0.443) = 一 3.9094 








Therefore， 


num _ 0 .443 扎 0.307 75) _ 0 03487 


0 [ 亿 3.9094) 





and 
X 一 妈 十 AX=0.7 十 0.03487 = 0.73487 
Since the result is within the established brackets, we accept it. 
Rel/apel points Asx > 如,the points are relabeled as illustrated in Figs. 4.2(b) and 
4.3(b): 


X]1 < X3 三 :0.7 


万 < 方 =0.443 
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妇 <X 一 0.73487 
户 = 0.734873 - 10(0.73487) 2” 十 5 = 一 0.00348 


The newbrackets on the Ioot are (2 ,2) = (0.7, 0.734 87). 


Secona interpoljation cycle ApplyingtheinterpolationinEq.(4.2) again,weobtain 
(Skipping the arithmetical details) 


AX 一 一 0.00027 
X 一 妈 十 AXx=0.73487 一 0.00027 = 0.73460 


Again x falls within the latest brackets, so the result is acceptable. At this stage, X is 
Correct to five decimal places， 


EXAMPLE 4.5 
Compute the zero of 


Jo) =XlcosXl 一 1 
that lies in the interval (0, 4) with Brents method. 


Solution 









上 = 


帮 ) | 


呈 
LA 
己 
1 
| 
1 
| 
一己 二 同一 一 二 = 本 | 


二 Se 汪 全 < 














-1.00 
0.00 0. 





上 上 
| 
0 1.00 150 2.00 2.30 3.00 3.30 4.00 


tn 攻 ==es=== 


Theplot of Fo showsthatthis is arathernastyfunction within the speciftied interval， 
containing a Slope discontinuity and two local maxima. The sensible approach is 
to avoid the potentially troublesome regions of the function by bracketing the root 
as tightly as possible from a visual inspection of the plot. In this case, the interval 
(4, 门 = (2.0,2.2) wouldbeagood starting point for Brents algorithm. 
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4.5 


Is Brents methodrobustenough tohandle the problem with the original brackets 
(0, 4)? Well here is the MATLAB command and its outpnut: 


>> brent(QaQfex4_5,0.0,4.0) 
ans 一 
2.0739 


The result was obtained after six iterations. The function defining 三 Co is 


function Yy = fex4_5(X) 
% Function used :in ExXxample 4.5 


Y = Xx*abs(Ccos(xX)) - 1.0; 


Newton-Raphson Method 


The Newton-Raphson algorithm is the best-known method of finding roots for a 
good reason': it is Simple and fast, The only drawback of the method is that it uses 
the derivative 万 (x) of the function as well as the function 太 o itself. Therefore, the 
Newton-Raphson methodis usable onlyin problems where 广 (x) can bereadily com- 
puted. 

The Newton-Raphson formula can be derived from the Taylor series expansion 
of Fo about X: 


Fo = Fo 上 + Po 一 英 二 OO 一 2 (a) 
I 开 Xi+lis aroot of /2x) = 0,Eq. (al becomes 
0= Fo) 二 户 C] CH1 一 辣 ) 十 OO 一 六 ) (b) 


Assuming that xi is a close to X%+l we can drop the last term in Eq. (b) and solve for 
Xi+l. The result is the Newton-Raphson formula 
0) 
六 0) 
HIxdenotesthetruevalue oftheroot theerrorinis Bi; 一 X 一 .Itcanbeshown 
that 让 x+lis computed 位 om Eq. (4.3), the corresponding error is 
站 (OO) ] 
忆 ， 1 一 一 有 
1 夺 1 2 太 Oo) 7 


Ji 十 1 一 好 (4.3) 








indicatingthattheNewton-Raphsonmethod converges qVCC1Qtica1jy (the erroris the 
Square of the error in the previous step). As a consequence, the number of signicant 
fgures is roughly doubled in every iteratiomn, provided that Wi is close to the root. 
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Tangent line 






| Eigure 4.4. Graphical interpretation of the Newton-Raphson 
1(XD) formula. 
| 





A graphical depiction of the Newton-Raphson formula is shown in Fig. 4.4. The for- 
mulaappIroximates 帮 x) bythe straightline thatis tangentto the curve ati.Thus +1 
is at the intersection ofthe x-axis and the tangent line. 

The algorithm for the Newton-Raphson method is simple: it repeatedly applies 
Eq. (4.3), starting with an initial value xm, until the convergence criterion 


| x+1 一 加 | < 8 


is reached, s beingthe errortolerance. Onlythe latestvalue ofxhas to be stored. Here 
is the algorithm: 


1. Letxbeaguess forthe root of 太 x) = 0. 
2. Compute Ax = 一 帮 00/ 广 0. 
3. Letx 和 二 X 十 AXandrepeatsteps 2-3 until |Ax| < 8. 


F() 帮 (0 








(a) (b) 
Figure 4.5. Examples where the Newton-Raphson method 
diverges. 


Although the Newton-Raphson method converges fast near the root its global 
conveIgence characteristics are pooI. The reason is that the tangent line is not al- 
ways an acceptable approximation ofthe function, as illustrated in the two examples 
in Fig.4.5.Butthemethodcanbemadenearlyfail-safebycombiningitwith bisectiom， 
as in Brents method. 


国 mewtonRaphson 





The following saje versiom of the Newton-Raphson method assumes that the root 
to be computed is initially bracketed in (a,b). The midpoint of the bracket is used 
as the initial guess of the root. The brackets are Updated after each iteration. I a 


4.5 Newton-Raphson Method 


Newton-Raphson iteration does not stay within the brackets, it is disregarded and 
Ieplaced with bisection. Since newtonRaphson Uses the function f(Cx) as well as its 
derivative, function routines forboth (denoted by funcanddfuncin thelisting) must 
be provided by the user. 


function root = newtonRaphson(Cfunc ,dqfunc,a,b,tol) 

% Newton-Raphson method combined with bisection for 
% finding a root of ECGX) = 0. 

% USAGE : foot = newtonRaphsonCfunc ,qdqfunc,a,b,tol) 

% INPUT : 


% func handle of function that Teturns E(X) . 


% dfunc = handqdle of function that Teturns 工 ' (X) . 


% ab = brackets (imits) of the root . 

% 七 DJ = _ error tolerance (default Is 1.0e6x*eps) . 

% OUTPUT : 

% root = Zero of f(Cx) (root = NaN If no convergence) . 


If nargin < 5; tol = 1.0e6*eps; end 

fa = feval(Cfunc,a); fb = feval(Cfunc,b) 
If fa == 0; foot = aij ieturni;i end 

If fb == 0; foot = bi teturni;i end 

了 于 王 axfb > 0.0 


erLror( "Root Is pnhot bracketed :in (人 a,b) ") 


X= (aa+b)/2.0; 
for 工 = 1:30 
fx = fevalLl(Cfunc ,和 X) ; 
If abs(Cfx) < tol; root = Xi Teturni;i end 
% TIighten brackets on the Yoot 
了 主 天 0393 D 三 区? 
else; aa = ; 
end 
% TYFY Newton--Raphson step 
dfx = feval(Cdfunc ,和 X) ; 


If abs(Cdfx) == 0; axX =b - ai 
ese;i dqxX = -Ex/dfxi 
end 


又 = 和 + dxi 
% If X not in bracket，use bisection 
If (b- X)x*GX- al) < 0.0 
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ax = (b - a)/2.0; 
又 =a+dxi 

end 

% Check for convergence 

If abs(dqx) < tolxmax(b,1.0) 
Toot = Xi Teturn 

end 

end 


Foot = NaN 


EXAMPLE 4.6 
Aroot of Fo =x 妈 3 一 10xz 二 5=0lies closetox=0.7. Compute this root with the 
Newton-Raphson method. 





Solution The derivative of the function is 户 (0o = 3x2 一 20X, so that the Newton- 
Raphson formula in Eq. (4.3) is 





Jj0 -。 交 一 100 +5 22 一 10 刀 一 5 


Po 3X2 一 20X X(3x 一 20) 





It takes only two iterations to Ieach five decimal place accuracy: 


2 和 .73 一 10(0. 22 一 筷 
0.7[3(0.7) - 20] 
2(0.73536)3 -- 10(0.73536)2 一 5 
0.73536 [3(0.73536) -- 20] 





一 0.735 36 


一 0.73460 





EXAMPLE 4.7 
Find the smallest positive zero of 


Jo0 = 太一 6.473 十 6.45X2 十 20.538x 一 31.752 
solution 





/100 
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Inspecting the plot of the function,， we Suspect that the smallest positive zero is a 
double rootnearx = 2.Bisection and Brents methodwouldnotworkhere, since they 
depend on the function changing its sign at the root. The same argument applies to 
the function newtonRaphson. But there no Ieason why the unrefined version of the 
Newton-Raphsonmethodshouldnotsucceed.Weusedthefollowingprogram, which 
prints the number of iterations in addition to the root: 


function [root ,numItez] = newton_simple(Cfunc,dfunc,X,tol) 


% Simple verslion of Newton-Raphson method used :in Example 4.7.， 


If nargin < 5; tol = 1.0e6*eps; end 
ftor 奔 = 1:30 
dx = -feval(Cfunc,X)/feval(Cdfunc ,和 X) ; 
又 =X 和 + dxi 
If abs(dx) < tol 
Toot = Xi numIter = 工 )】 Teturn 
end 
end 


Toot = NaN 
The two functions called by the program are 


function Yy = fex4_7(XxX) 
% Function used :in Example 4.7. 
YY=X 4- 6.4*X` 3 + 6.45x*X`2 + 20.538*X - 31.752; 


function Yy = dfex4_7(X) 
% Function used :in Example 4.7. 
YY=4.0*X` 3 - 19.2*X`2 + 12.9*X + 20.538 


Here are the results: 


>> [root ,numIter] = newton_simple(Qfex4_7,Qdfex4_7,2.0) 
Toot = 

2.1000 
DuUmItez = 三 

27 


Itcanbeshownthatnearamultiplerootthe convergence ofthe Newton-Raphson 
methodis linear ratherthan quadratic, which explains thelargenumber ofiterations，. 
Convergencetoamultiplerootcan bespeededup byreplacing the Newton-Raphson 
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4.6 


formula in Eq. (4.3) with 

Jo0) 

大 (5) 

where 1 is the multiplicity of the root (72= 2 in this problem). After making the 
change in the above program, we obtained the result in 5 iterations. 


JW+1 二 好 一 11 





Systems of Equations 
Introduction 


Up to this point we confined our attention to solving the single equation 三 20 = 0. 
Let us now consider the 1-dimensional version of the same problem, namely 


foxg =0 
om using scalar notation 
万 (而 萄 5 三 0 
户 0, 和 如 ,区 三 0 (4.4) 


加 状 囊 ， 光 二 0 


The solution of simultaneous, nonlinear equations is a much more formidable task 
thanfindingtherootofasingleequation.IThetroubleisthelackofareliablemethodfor 
bracketing the solution vectorX. Therefore, we cannot provide the Solution algorithm 
with a guaranteed good starting value of x unless such a value is suggested by the 
physics of the problem， 

The simplest and the most effective means of computing Xx is the Newton- 
Raphson method. It works well with Simultaneous equations, pIovided that it is sup- 
plied with a good starting point. There are other methods thathave better global con- 
vergence characteristics, butall ofthem are variants ofthe Newton-Raphson method. 


Newton-Raphson Method 


In order to derive the Newton-Raphson method for a system of equations, we Start 
with the Taylor series expansion of 万 C about the point X: 


态 区 二 Aa = 廊 C9 十 >》， 0 十 O(AX2) (4.5a) 
JE 
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Dropping terms of order AxX2, we can write 了 上 q. (4.5a) as 
fx 十 AN) = fx 十 Jo AxX (4.5b) 


where Jo is the /ccopiam 124trix (ofsize7x7 门 madeup ofthepartial derivatives 


0 大 
攻 三 


4.6 
5 (4.6) 
Note that Eq. (4.5b) is a linear approximation (vector AXx being the variable) of the 
vector-valued function fin the vicinity ofpoint X. 

Letus now assume thatxis the current approximation ofthe solution off(Co = 0， 
andletx 十 Axbetheimprovedsolution.TIofindthe correction Az wesetf(x 二 Ag =0 


in Eq. (4.5b). The resultis aset of linear equations for Ax: 
JoOAX = 一 foog) (4.7) 


The following steps constitute the Newton-Raphson method for simultaneous， 
nonlinear equations: 


Estimate the solution Vector X. 

Evaluate fo). 

Compute the Jacobian matrix JCx) from Eq. (4.6). 

Set up the simultaneous equations in Eq. (4.7) and solve for AxX. 
LetXx < X 二 AXxand repeat Steps 2-5. 


人 


The above process is continued until |Ax| < s, where s is the eriror tolerance. As 
in the one-dimensional case, Success of the Newton-Raphson procedure depends 
entirely on the initial estimate ofx. Hagood startingpointis used, convergence to the 
Solution is very Iapid. Otherwise, the results are unpredictable. 

Because analytical derivation of each 5 大/39xj can be difficult or impractical it is 
preferable to let the computer calculate the partial derivatives from the finite differ- 
ence appIOximation 

旷 、 天 ET+Tei 用 一 大 9 


02 必 





where Pis a small increment and ej Tepresents a unit vector in the direction of x 
This formula can be obtained from Eq. (4.5a) after dropping the terms of order AxX” 
and setting Ax= ej) 几 Byusingthefinite difference approximation, we also avoid the 
tedium oftyping the expressions for 9 户 /axj into the computer code. 


国 mewtonRaphson2 





Thisfunctionis animplementation oftheNewton-Raphsonmethod.Thenestedfunc- 
tion jacobiancomputesthejJacobianmatrixfromthefinite difference approximation 
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in Eq. (4.8). The simultaneous equations in Eq. (4.7) are Solved by using the left di- 
vision operator of MATLAB. The function Subroutine func that returns the array fg) 
must be Supplied by the user. 


function root = newtonRaphson2(Cfunc,Xx,tol) 
”% Newton-Raphson method of finding a foot of simultaneous 
%- eguatoimS 革 荆 ( 文 1 交 2 7 站 ) 二 0 二 三 工 ,22 7 了 


% USAGE : Toot = DnewtonRaphson2(Cfunc,X,tol) 


% INPUT : 
”% func = handle of function that returns[f1l1,f2,...,fnl]. 
9% 买 = Starting solution vector [X1L,Xx2,，...，xn]. 
% tol = error tolerance (qdqefault 1Is 1.0e4x*eps) . 
% OUTPUT : 
% Toot = Solution Vector . 
If narglin == 2; tol = 1.0e4*eps;i end 
If Size(X,1) == 1; X = Xi end % X must be column Vector 
for 奔 = 1:30 
[Jac,f0] = JacobianCfunc ,X) ; 


If sdqrt(Cdqdot(f0o ,f0)XLength(Cx)) < tol 


Toot = Xi TetuTn 


dxX = JacNC=-fE0) ; 
又 ==X+ dxi 
If sdqrt(dot(dqx,dqx)/Length(Cx)) < tolxmax(Cabs(x) ,1.0) 
Foot = Xi TeturDn 
end 
end 


error(' TIToo many IteratiIons ') 


function [Jac,f0] = Jacoblian(Cfunc,X) 


% Returns the Jacobian matrlix and 工 (X) . 


Php=1.0e-4; 
nn = Length(CX) ; 
Jac = Zeros(n) ; 


tE0 = 三 feval(CEune yi 区) ， 
fozr 工 =1:Dn 
temp = X(CI) 
X(CID) temp + Ph; 
f1 = feval(Cfunc,X) ; 
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X(I) = temp; 

Jac(:,I) = (fl1L - f0)/Xhi; 
emnd 

Notethatthe Jacobian matrixJOx is recomputedin each iterativeloop. Since each 

calculation of Joo involves 刀 十 1 evaluations of fo (Pis the number of equations)， 
the expense of computation can be high depending on 0 and the complexity of fCo). 
It is often possible to save computer time by neglecting the changes in the Jacobian 
matrix between iterations, thus computing Jo only once. This will work provided 
thatthe initial xis suffGiciently close to the solution. 


EXAMPLE 4.8 
Determine the points of intersection between the circle x2 十 2= 3 and the hyper- 
bola xy = 1. 


solution The equations to be solved are 


亡故 =x22++ 帮 2--3=0 (a 
户 志 有 帮 = 妙 -1=0 (b) 
The Jacobian matrix is 
0 请 /0x 9 及 /37 2X 27 
丁 9 一 一 
必 5 ，。 4 攻 | 


Thus the linear equations JOOAx= -fo associated with the Newton-Raphson 


method are 
2X 2y || Ax 一 X2 一] 十 3 
一 (C) 
多 Ay 一 zy 十 1 


By plotting the circle and the hyperbola， we see that there are four points of 
intersection. Itis sufficient, howevep to find only one ofthesepoints, as the others can 
be deduced from symmetry From the plotwe also getarough estimate ofthe coordi- 
nates of an intersection point:X = 0.5,y = 1.5, which we use as the starting values. 


包 











The computations then proceed as follows. 
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First iteration Substitutingx = 0.5,y = 1.5 in Eq. (c), we get 


1.0 3.0 AX | _ | 0.50 
1.5 0.5|| Ay | 10.25 
the solution ofwhich is Ax = Ay = 0.125. Therefore, the improved coordinates ofthe 


intersection point are 


X 一 0.5 十 0.125 = 0.625 =1.5 十 0.125 =1.625 


Seconal iteration Repeating the procedure using the latest values of x and )， we 


obtain 
1.250 3.250 Ax | “| -0.031250 
1.625 0.625 || Ay | “| -0.015625 
which yields Ax = Ay = 一 0.00694. Thus 


X 一 0.625 -- 0.00694 = 0.618 06 =1.625 -- 0.00694 = 1.618 06 


TPira iteration Substitution ofthe latestYand y into Eq. (c) yields 
| 12 | 网 mn | 
1.618 06 ”0.61806 Ay 一 0.000 058 
The solution is Ax = Ay = 一 0.00003, So that 
X= 一 0.61806 -- 0.00003 = 0.618 03 


三 1.618 06 -- 0.000 03 = 1.618 03 


Subsequentiterations wouldnot changetheresults within five significantfgures. 
Therefore, the coordinates ofthe four intersection points are 


士 (0.618 03, 1.618 03) and 士 (1.618 03, 0.618 03) 


Alternate solution Ifthere are only a few equations, it may be possible to eliminate 
all but one of the unknowns. Then we would be left with a single equation which 
can be solved by the methods described in Arts. 4.2-4.5. In this problem, we obtain 
from Eq. (b) 


1 
炎 二 过 


which upon substitution into Eq. (a] yields x2 + 1/X2 一 3 = 0, or 
X4--3x2 二 1=0 


The solutions of this biquadratic equation: x = 士 0.618 03 and 士 1.618 03 agree with 
the results obtained by the Newton-Raphson method. 
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EXAMPLE 4.9 
Find a solution of 
sinx 二 JJ +Inz-7=0 
3x+27 一 到 +1=0 
X 十 十 Z 一 5=0 


using newtonRaphson2. Start with the point (1, 1, 1]). 
solution Lettingx= xy 三 和 andz= zthecode definingthefunction array fx is 


function Yy = fex4_9(X) 
% Function used in Example 4.9 
Y= [sinCXxC1LI)) + XC2) 2 + Log(CX(C3)) - 7; 
3x*X(C1) + 2 `XC2) - XC3) 3 + 工 ; 
XC1L) + XC2) + X(C3) - 5]; 


The solution can now be obtained with the single command 
>> PhnewtonRaphson2(Q@fex4_9,[1;1;1]) 
which results in 


ans = 
0.5991 
2.3959 
2.0050 


Hence the solution is x = 0.5991,y = 2.3959 andZz = 2.0050. 


PROBLEM SET 4.1 


1 Use the Newton-Raphson method and afour-function calculator (十 一 x 二 Oper- 
ations only) to compute V75 with four sign 诊 cantfgure accuracy. 





2. Find the smallest positive (real root of x3 -- 3.23X2 一 5.54x 十 9.84 = 0 by the 
method ofbisection. 


3. Thesmallestpositive,nonzerorootofcoshxcosx 一 1=0liesintheinterval (4, 5). 
Compute this root by Brents method. 


4. Solve Prob. 3 by the Newton-Raphson method. 


5. Arootoftheequation tanx 一 tanhx= 0liesin (7.0,7.4).Findthisroot with three 
decimal place accuracyby the method of bisection. 

6. Determine the two roots of sinx 十 3cosXx 一 2=0thatlie in the interval (一 2, 2). 
Use the Newton-Raphson method. 
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7. Apopularmethod ofhand computation is the seca12tj772Uwheretheimproved 


10. 


下 5 
2， 
13. 
14. 
15. 


estimate of the root (+ is obtained by linear interpolation based two previous 
estimates (2 and X_1): 


好 一 北 -1 


Jo) -6 





Ji+1 一 好 


了 CO 


Solve Prob. 6 using the secant formula. 


Drawaplot of 帮 x) = coshxcosXx 一 Lintherange4<X<8.(al Verify from the 
plot that the smallest positive, nonzero root of Fx) = 01lies in the interval (4, 5). 
(b) Show graphically that the Newton-Raphson formula would not converge to 
this root 过 it is started with x = 4. 


Theequation x3 -1.2x2 -- 8.19x 十 13.23 = 0hasadoublerootclosetox = 2.De- 
termine this root with the Newton-Raphson method within four decimal places. 





国 Wiite a program that computes all the roots of /oo = 0inagiven interval with 
Brents method. Utilize the functions rootsearch and brent. You may use the 
program in Example 4.3 as a model. Test the program by finding the roots of 
XSinX 十 3cosX 一 XY 一 0in (一 6,6). 


国 Solve Prob. 10 with the Newton-Raphson method. 





国 Determine all real roots of x4 十 0.9X3 一 2.3X2 十 3.6x -- 25.2 = 0. 
国 Compute all positive real roots of x4 十 2X3 一 7X2 十 3 = 0. 
国 Find all positive, nonzero roots ofsinXx 一 0.1X=0. 


国 The natural frequencies of a uniform cantilever beam are related to the roots 
Bi; ofthe frequency equation 帮 (8) = cosnb cosb8 二 1= 0,where 


711 3 
4 2 
Bi =(27 用 互 7 


万 = ;ithnatural frequency (cps) 


10 = mass ofthe beam 
工 =length ofthe beam 
忆 = modulus of elasticity 


了 一 momentofinertia ofthe cross section 


Determine the lowest two frequencies of a steel beam 0.9 m long, with a rectan- 
gular cross Section 25 mm wide and 2.5 mm in. high. The mass density of steel is 
7850 kg/ms and 巨 = 200 GPa. 
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16. 


17. 





Length =S 


Asteelcable oflengthsis suspendedas shown in thefigure.The maximum tensile 
Stress in the cable, which occurs at the Supports, is 


amax 一 aocoshB 


where 


_ 了 
加 2c0 


00 = tensile stress in the cable at O 
7》 = weight ofthe cable per unit volume 
世 = horizontal span ofthe cable 


The length to span ratio ofthe cable is related to 8 by 
1 


Find cmax 放 yy = 77 x 103 N/mas (steel), 工 = 1000mands = 1100 m. 
力 


e 
尸 | - - Lp 


和 = 


























Thealuminum W310 x 202 (wideflange) columnis subjectedto an eccentric axial 
load P as shown. The maximum compressive stress in the column is given bythe 
SO-called seca1t Jor72V1G: 


eC 了 上 /5 


0 三 PP/4=average stress 


where 


4= 25800mm2 = cross-sectional area ofthe column 
ee 一 85 mm 一 eccentricity ofthe load 
c=170mm = half-depth ofthe column 


六 = 142 mm = Iadius of gyration of the cross Section 
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18. 


19， 


工 王 7100 mm = length ofthe column 
已 = 71 x 102 Pa = modulus ofelasticity 


Determine the maximumload Pthatthe column can carry 计 tthe maximum stress 
is not to exceed 120 x 106 Pa. 





Bernoullis equation forfluid flow in an open channel with a small bump is 


Q” Q@Q” 


= 
2 一 250 


where 


Q = 12m3/s = volume rate offlow 

8 = 9.81 my/s2 = gravitational acceleration 
了 =1.8m = width of channel 

1o = 0.6m = upstream water level 

五 = 0.075 m = height ofbump 


屎 = water level above the bump 


Determine 太 . 


国 The speedyvofa Saturn VIocket in vertical fight near the Surface of earth can 
be approximated by 





where 


&U = 2510 my/s = velocity ofexzhaust relative to the Iocket 
Mo = 2.8 x 106 kg = mass ofrocket at liftoff 
放 = 13.3 x 103 kg/s = rate of fuel consumption 
8g = 9.81 my/s2 = gravitational acceleration 
L = time measured from lifto 储 


Determine the time when the rocket reaches the speed of sound (335 my/Ss). 
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20. 


之 ] 


到 2 


23. 


24. 


己 
8 瑟 







lsothermal 


Heating at expansion 


constant vdqlume 


有 








The fgure shows the thermodynamic cycle of an engine. The etciency of this 
engine for monatomic gas is 
(了 一 和 一 五 /区 
In(2/)+(G 一 五 / 屯 )/0 一 了 
where T is the absolute temperature andy7y = 5/3. Find 史 /五 thatresults in 30 兄 
efciency (7 = 0.3). 





看 Gibb's free energy ofone mole ofhydrogen at temperature 7 is 
G=-RTmn[(CVD)25] 林 
where 尺 = 8.31441 J/K is the gas constant and 7T0 = 4.44418 上 . Determine the 


temperature at which G = 一 105 丁 


国 The chemical equilibrium equation in the production of methanol from CO 
and H2> is8 


E(3 一 28)? 
(5 


Where 5 is the eqVZ1DF7a extentortipe reaction. Determine 5. 


一 249.2 


国 Determine the coordinates ofthe two points wherethe circles (X 一 2 十 ] 一 4 
andx2 十 (一 3)2= 4intersect,Startbyestimatingthelocations ofthepoints from 
a Sketch of the circles, and then use the Newton-Raphson method to compute 
the coordinates，. 


国 The equations 


SinX 十 3cosXx 一 2 一 0 
CosSX 一 Siny 十 0.2=0 


haveasolutioninthevicinityofthepoint (1, 1]).UsetheNewton-Raphsonmethod 
to refine the solution. 


8 From Alberty R.A., Pjysical Cjeraistrm 7th ed., Wiley 1987. 
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25; 


26. 


世态 


28. 


国 Use any method to find Cj real solutions in 0 <X< 1.5 of the simultaneous 
equations 


tanX 一》 三 工 
cosxXx 一 3siny =0 


国 The equation of a circle is 
GC 一 中 +Q 一 夏 = 天 


where Ristheradius and (da 站 arethe coordinates ofthe center. Ifthe coordinates 
of three points on the circle are 





X | 8.21 | 0.34 | 5.96 
) | 0.00 | 6.62 | 一 1.12 























determine 愉 , ga and 2. 


The trajectory of a satellite orbiting the earth is 


C 
1+esin(9 十 wo) 





where (R,o) arethepolar coordinates ofthe satellite, and C,eand wa are constants 
(e is known as the eccentricity of the orbib. 玉 the satellite was observed at the 
following three positions 





O0 一 30? 0? 30” 
及 (km) | 6870 | 6728 | 6615 























determine the smallest Rofthe trajectory and the corresponding value of 0. 














国 
y 本 SS 
Ri 45、 
V 
oj 61 m 
1 肋 X 
300 m 一 一 一 


Aprojectile is launched at O with the velocity v at the angle 0 to the horizontal. 
The parametric equation of the trajectory is 


X 一 (coSsO)L 


1 . 
= 有 十 (zsing)t 
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where fis the time measured from the instant oflaunch, andg = 9.81 my/ S2 Tep- 
Iesents the gravitational acceleration. Ifthe projectile is to hitthe target at the 45? 
angle shown in the figure, determine 区 0 and the time of flight. 


29. 轩 








The three angles shown in the fgure ofthe four-bar linkage are related by 


150 coso6l 十 180 coso6， 一 200coso63s = 200 
150sino0l 十 180sino> 一 200sinb63s =0 


Determine 01 and0> when 03 = 75". Note that there are two solutions. 


“4.7 Zeroes of Polynomials 
Introduction 
Apolynomial of degree 刀 has the form 
忆 (X] = QIX2 十 GaN 十 十 CoX 十 Cil (4.9) 


where the coefficients may be real or complex. We will concentrate on polynomi- 
als with real coeffhicients, but the algorithms presented in this article also work with 
complex coef 愉 cients. 

The polynomial equation 忆 ,(2) = 0 has exactly 7 roots， which may be real or 
complex. Hthe coefficients are real the complexroots always occurin conjugate pairs 
006++10, 一 2) wherey andxiaretherealandimaginary parts, respectively For 
Ieal coefticients, thenumber ofreal roots can be estimated from the rie ojDescartes: 


。 The number of positive, real roots equals the number of sign changes in the 
expression for 书 ,(O, or less by an even number. 

。 The number of negative, real roots is equal to the number of sign changes in 
也 (一 2, orless by an even number. 


As an example，consider 户 (00 =x3 一 2x 一 8x 十 27. Since the sign changes 
twice， 户 (X) = 0 has either two oOT zero positive real roots. On the other hand， 
户 ( 一 困 = 一 X3 一 2xX2 十 8x 十 27 contains a single sign change; hence 乌 (X) possesses 
one negative real zer0. 


Roots of Equations 


The real zeroes ofpolynomials with real coefficients can always be computed by 
one of the methods already described. But 让 complex roots are to be computed, it is 
besttouseamethodthatspecializesinpolynomials. Here wepresentamethod dueto 
Laguerre, which is reliable and simple to implement. Before proceeding to Laguerres 
method, we must first develop two numerical tools that are needed in any method 
capable of determining the zeroes of a polynomial. The first of these is an efhicient 
algorithm for evaluating a polynomial and its derivatives. The second algorithm we 
needis forthe de1jatioz ofapolynomial ie for dividingthe 己 (x) byx 一 六 whereryis 
arootof P,(x) = 0. 


Evaluation of Polynomials 


Itis tempting to evaluate the polynomial in Eq. (4.9) from left to rightby the following 
algorithm (we assume that the coefficients are stored in the array al: 


for 工 = 1:mn+1l 
P + a(CI)*X” (Cn-I+L) 


忆 
中 


Since xzktis evaluatedasXxxXxx:.…xx(K 一 1 multiplications), we deducethatthe 
number ofmultiplications in this algorithm is 





1 
1 十 2 十 3 十 …: 十 用 1 一 了 202 ]) 


Hpislarge, thenumber ofmultiplications can bereduced considerably 让 we evaluate 
the polynomial from right to left. For an example, take 


Pi = CiX4 二 aoX3 十 03X2 十 CC4X 十 G5 
which can be rewritten as 
疡 (0 = 一 05 十 XY{fa4 十 X[G3 十 X(G2 十 XGI)]} 


We now see that an efficient computational Sequence for evaluating the poly- 
Domial is 


媚 00 = 4 

已 00 = 0 十 XYPOO 
忆 (0) = Ga 十 X 户 (2 
已 (0 = 04 十 X 户 0 
忆 (X) = 05 十 X 记 (00 


4.7 Zeroes of Polynomials 


Eorapolynomial of degree 1 the procedure can be Summarized as 


矶 Oo0 = 存 
六 丽 三 : 硝 天 下 汪 属于 三 1 25 沪 (4.10) 


leading to the algorithm 


D = a(C1); 
主 O 王 二 三 工 芋 看 
PP = px*X+a(Ci+l) 


emnd 


The last algorithm involves only 2 multiplications, making it more effhicient for 
1. > 3.Butcomputational economyis notthe prime reason whythis algorithm should 
be used. Because the result ofeach multiplication is rounded oft, the procedure with 
the least number of multiplications invariably accumulates the smallest roundo 侍 
eIIOTL. 

Some root-fnding algorithms, including Laguerres method, also require eval- 
uation of the first and second derivatives of 忆 (O. From Eq. (4.10) we obtain by 


differentiation 
记 几 = 三 0 帮 ( 同 三 户 31 癌 于 XP (网 25 (4.11a) 
忆 00=0 Po0=2P 00 二 +XP OO，7==12.. .7 (4.11b) 
国 eva PoJlYy 


Here is the function that evaluates apolynomial and its derivatives: 


function [p,dqp,dqdp] = evalpoly(a,X) 

% Evaluates the polynomial 

%p=a(C1L)x*xn+ a(2)*xX (Cn-1) + ... 二 aCn+l) 
% and its first two qdqerivatives dp and ddp . 
% USAGE: [p,dqp,dqdp] = evalpoly(Ca,X) 


| 
中 


ength(Ca) - 工 ; 

al dp 三 02507 QQ 三 .0 
for 二 = 工 :m 

ddqdp = ddqdp*X + 2.0*dp; 

dp = qdqpx*x + P; 


忆 
中 


DPD= 了 Pr*x+a(Ci+Ll)， 


end 
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Deflation of Polynomials 


After arootr of P,(x) = 0has been computed, itis desirable to factor the polynomial 
as follows: 


疡 (= (一 门 忆 _100 (4.12) 


This procedure, known as deflation or syzzt 妨 etic divisio1, involves nothing more than 
computing the coefficients of 忆 1(0). Since the remaining zeros of P(z) are also the 
Zerosof P_1(0o,theroot-fndingprocedure cannowbeappliedto 忆 _1(0 ratherthan 
P(00. Deflation thus makes it progressively easier to find Successive roots, because 
the degree of the polynomial is reduced every time a root is found. Moreover by 
eliminating the roots that have already been found, the chances of computing the 
same rootmore than once are eliminated. 
Ifwe let 


局 = DXI 十 DoX2 十 .十 忆 1 十 
then Eq. (4.12) becomes 

CIXZ 十 CoX 1 十 .十 CA 十 Col 

= (一 门 (Dixz7 十 DoXm 十 十 芒 -IX 十 历 
Equating the coefficients of like powers of zx we obtain 
D1 一 G1 D2 一 0 二 1D 及 = 帮 十 FFD 1 (4.13) 

Which leads to 有 Formers dej1atiom QiSgorztpP77: 
b(C1) = a(C1) ; 
fozr 工 = 2:n 


b(Cz) = a(CI) + TYx*b(CI-IL) ; 


end 


Laguerre's Method 


Laguerresformulas arenoteasily derivedforageneralpolynomial P,(x.However the 
derivation is greatly Simplified 让 we consider the special case where the polynomial 
hasazeroatx 王 rand(1 一 1)zerosatx=d9.Itthezeroswereknown,this polynomial 
can be written as 


Pi = (一 门 K 一 9 (a 
Our problem is now this: given the polynomial in Eq. (a) in the form 


7 一 1 


疡 (00 一 @X 十 2X 十 :十 0 十 Orl 
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determine 7r (note that q is also unknown)j. It turns out that the result which is ex- 
act for the Special case considered here, works well as an iterative formula with any 
polynomial. 

Differentiating Eq. (a] with respect to X we get 


PiO0 = 一 9 一 TDCC 一 门 KC 一 o 可 于 


荆 九 一 工 
=- PO( 二 + ) 
X 一 7 7X- 一 d9 























Thus 
也 /( 划 1 九 一 1 
PP = 二 四 ) 
which upon differentiation yields 
P700 『Poo 了 1 1 一 1 区 
Pi LPG- 站 2 一 吃 ? 
It is convenientto introduce the notation 
_ 忆 0O0 四 厂 (J 
Co 三 已 五 (20 = G“( 蕊 局 (4.14) 
So that Eqs. (b) and (c) become 
下 
GOo = > (4.15al 
X 一 7 7X 一 9 
1 有 九 一 | 
用 二 十 (4.15b) 





人 一 门 ” 区 一 几 ? 
H 开 we solve Eq. (4.15a) forx 一 gand substitute the result into Eq. (4.15b), we obtain a 
quadratic equation forx 一 六 The solution ofthis equation is the ZLCSverTes 加 7r72U1C 


用 


克 一 了 一 
GO+Vw-D[aEoo - Gz0] 





(4.16) 





Theprocedure forfinding a zero ofa general polynomial by Laguerres formula is: 


1. Letxbeaguessfortheroot of P,(x) = 0 (anyvalue will do). 

2.， Evaluate 已 0, PO and PoO using the procedure outlined in Eqs， (4.10) 
and (4.11). 

3. Compute C(X] and 万 (xz) from Eqs. (4.14). 

4. DeterminetheimprovedrootrfromEq. (4.16) choosingthesignthatresults in the 
/CT78er1708111de ofrpedeo721120tor (this canbeshowntoimprove convergence). 

5.，Letx < 二 randrepeatsteps2-5 untillP,(CO| <sorlx 一 r| <swheresisthe error 
tolerance. 


Roots of Equations 


One nice pIoperty of Laguerres method is that converges to aroot with very few 
exceptions, from any starting value of X. 


国 PolyRoots 


The function polyRoots in this module computes all the roots of P(O = 0， 
where the polynomial 忆 (x) defined by its coefficient array a = [Qi , 02, 03,.. ,Gil1]. 
After the first root is computed by the subfunction laguerre, the polynomial is de- 
fated using deflPoly and the next zero computed by applying laguerre to the 
deflated polynomial. This process is repeated until all 7 roots have been found. 
Ia computed root has a very small imnaginary parb it is very likely that it rep- 
Iesents Toundofft error. Therefore，polyRoots Ieplaces a tiny imaginary part by 
ZerI0. 


function root = polLlyroots(a,tol) 
% Returns all the zfzoots of the polynomial 
% a(CL)*x mn + a(2)*x (Cn-1) + ... 二 aCn+l). 
% USAGE : Toot = polLlyroots(a,tol) . 


% tol = error tolerance (default Is 1.0e4*eps) . 


If mnargin == 1; tol = 1.0e-6; end 
nn = Length(Ca) - 工 ; 
Foot = Zeros(n,1); 
fozr 工 = 工 :nm 
X = Laguerre(Ca,tol) ; 
If abs(imag(X)) < tol; X = Teal(x); end 
五 让 G 才 (> 三: 爱 
a = deflpoly(Ca,X) ; 


end 


function X = Laguerre(a,tol) 
% Returns a foot of the polynomial 
% a(C1L)*xn + a(C2)*x (Cn-1) + ... 二 aCn+l). 
X = Tandni % Start with random numbez 
nn = Length(Ca) - 工 ; 
for 工 = 1:30 
[p,dqp,dqdp] = evalpoly(Ca,X) ; 
If abs(P) < tolLl;i Teturni end 
有 = dp/Di = 砷 有 = ddp7P; 
王 = SQRT =- 工 )”(axH = 区 BID3 
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If abs(g + ff) >= abs(g - ff); dqx = ng + 工 ); 
else; dqx = n/(g - f); end 
又 ==X- dxi 
If abs(dx) < tol;i return;i end 
emnd 


erTror( Too many Iterations :in aguerre ) 


function b = deflpoly(Ca,T) 

% Horner 's deflation: 

% a(C1L)xx nn + a(C2)x*x (Cn-1) + ... 二 aCn+l) 

%= (XXX - TY)[b(C1)*x” (Cn-1) + b(C2)*x~ (Cn-2) + ..,+ bGCn)]， 
nn = Length(Ca) - 工 ; 

b = zeros(n,I) ; 

DEL 三 间 (C19)3 

for = 2:ni b(I) = a(CI) + xb(I-1L);i end 


Sincetheroots are computed with finite accuracy each deflation introduces small 
erTors in the coefficients ofthe deflated polynomial. The accumulated roundo 人 terror 
increases with the degree ofthepolynomial and can become severeiftthepolynomialis 
训 -conditioned (Small changes in the coefficients produce large changes in the roots). 
Hence the results should be viewed with caution when dealing with polynomials of 
high degree. 

The errors caused by deflation can be reduced by recomputing each root using 
the original undeflated polynomial, The roots obtained previously in conjunction 
with deflation are employed as the starting values，. 


EXAMPLE 4.10 
A zero of the polynomial Po = 3x4 一 10xz3 一 48X2 一 2X 十 12 isx= 6.Deflate the 
polynomial with Horners algorithm, ie find 户 (x) so that (Kx 一 6) 记 (0 = 忆 (0. 





solution With7=6and7= 4, Eqs. (4.13) become 


Di 一 0G1 一 3 

D2 = 一 0 十 6p1 = 一 10 二 6(3) =8 
2a = 0 十 6 = 一 48 二 6(8) =0 
D4 一 04 十 653 = 一 2 十 6(0) = 一 2 


Therefore， 


户 00 =3x3 十 8X2 一 2 
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EXAMPLE 4.11 

Aroot of the equation 户 ( = X3 一 4.0x2 -4.48X 十 26.1 is approximatelyX 一 3 一 L 
Find a more accurate value of this root by one application of Laguerres iterative 
formula. 


solution Use the given estimate of the root as the starting value. Thus 
X=3-i 人 =8-6i 妈 =18 一 26; 
Substituting these values in 户 (X) and its derivatives, we get 


户 (0 一 2 一 4.0X2 一 4.48X 十 26.1 
= (18 一 26) 一 4.0(8 一 6 一 4.48(3 -- 站 二 26.1= -1.34 十 2.48; 


局 00 = 3.0X2 一 8.0x 一 4.48 
= 3.0(8 一 6 一 8.0(3 一 方 一 4.48 = 一 4.48 一 10.0 


疡 (0 =6.0x 一 8.0=6.0(3 一 站 一 8.0=10.0 一 6.0; 











Equations (4.14) then yield 


尼 00 一 4.48 一 10.07 
”， 态 四 -1.34 十 248i 


Pr 100-60i 
一 (L2.36557 十 3.08462D2 一 
人 


一 0.35995 一 12.484527 


G(X) 





2.36557 十 3.084627 


万 (0 = G200 








The term under the square root sign of the denominator in Eq. (4.16) becomes 





FOOD = VO-D[zECoO - G209] 





四 Ms [3(0.35995 -- 12.484527 -- (一 2.36557 十 3.08462 六 2] 
= V5.67822 -- 45.719461 = 5.08670 -- 4.494027 





Now we must find which sign in Eq. (4.16) produces the larger magnitude of the 
denominator: 


1Goo + FOo| = |( 一 2.36557 十 3.084627 十 (5.08670 -4.494025| 
= |2.72113 - 1.40940i| = 3.06448 


1G(O 一 下 (| = |( 一 2.36557 十 3.084627) 一 (5.08670 一 4.494025)| 
一 | 一 7.45227 十 7.57864?1| = 10.62884 


Using the minus sign,， we obtain from Eq. (4.16) the following improved appIoxi- 
mation for the root 
用 3 
G 辣 二 FE 辣 一 ”二 745227 二 757864 
一 3.19790 -- 0.798757 








三 一 忒 
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Thanks to the good starting value, this approximation is already quite close to the 
exact value7 了 一 3.20 一 0.801. 


EXAMPLE 4.12 
Use polyRoots to compute dl the roots ofXx4 一 5X3 一 9x2 十 155x 一 250 = 0. 


solution The command 
>> PolLyroots([1 -5 -9 155 -250]) 
Iesults in 


ans = 
2.0000 
4.0000 - 3.00001 
4.0000 + 3.00001 
-5.0000 


There are two real roots (=2 and -5) and a pair of complex conjugate roots 
(一 4 土 37. 


PROBLEM SET 4.2 





Problems 7T-5 A zeroxz 一 rof Po is given. Verify that ris indeed a zero, and then 
deflate the polynomial ie., fnd 已 _1(x0) so that P(x) = (一 门 忆 100. 
1. 媚 00 =3x3 二 7XY2 一 36x 十 20,7r 一 一 5. 


2. PO =X4 一 3x2 十 3 一 17r=1. 

3. 户 00 =X5 一 30x4 十 361X3 一 2178x2 十 6588x 一 7992,7 = 6. 
4 

5 





.PiOO =X4 一 5x3 一 272 一 207 一 24 太 一 2 

. 书 00 =3x3 一 19x2 十 45x 一 13,7 一 3 一 2 
Probjems 6-9 Azerox=7rof PoOis given. Determine all the other zeroes of 己 ,(2) 
byusingacalculator. Youshouldneednotools otherthan deflation andthe quadratic 


formula. 
6. 户 00 =xX 二 1.8x2 -9.01x- 13.398,7 = 一 3.3. 


7. 户 (00 =X3 一 6.64X2 十 16.84x 一 8.32,7 = 0.64. 
8. 户 (00 =2x3 一 13x2 十 32X 一 13,7 一 3 一 2 
9. 忆 (00 =X4 一 3x3 十 10X2 一 6x 一 20,7 一 1 十 3 
Problems 170-76 Find all the zeroes of the given 忆 ,(0). 
10. 国 己 (xz) 一 X4 十 2.1Xx3 一 2.52X2 十 2.17 一 3.52. 
11. 国 户 (X) 一 X5 一 156x4 一 5X3 十 780X2 十 4 一 624. 
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2 
13. 
14. 
15， 
16， 





国 Pi(X) 一 X6 十 4X5 一 8x4 一 34X3 十 57X2 十 130x 一 150. 

国 忆 (ZX) 一 8X7 十 28x6 十 3475 一 13x4 一 124x3 十 19X2 十 220x -100. 

国 Pe(X) 一 X8 一 7X7 十 7X6 十 25X5 十 24X4 一 98x3 一 47272 十 4407 十 800. 
国 Pi(X) 一 X4 十 (5 十 力 X3 一 (8 一 5D)X2 十 (30 一 14Dx 一 84. 

国 





The two blocks of mass 7 each are connected by springs and a dashpot. The 
stifftness of each spring is 太 and c is the coeffhicient of damping of the dashpot. 
Whenthesystemisis displacedandreleased,the displacementofeachblock during 
the ensuing motion has the form 


侈 四 一 Akeor cos(wiE 十 罗 )， 天 一 12 


where 4 人 and are constants andw 一 or 十 ioiaretheroots of 





人 大 
0 十 2 一 十 3 一 Oo 十 0 十 一 0 
17 110 117 


Determine the two possible combinations ofmw; and wi 证 c/1= 12 s-1 and ly/ 太一 
1500 s-?. 


MIATLAB Functions 


驻 


fzeroCaefunc ,x0) returns the zero ofthe function func closest to X0. 
fzeroCaefunc,[a b]) canbeusedwhentheroothas beenbracketed in (a ,b). 


The algorithm used for fzero is Brents method. 


= roots(a) returns the zeros ofthe polynomial 己 (X) = CIX7 十 十 GX 十 Gil， 
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The zeros are obtained by calculating the eigenvalues of the .x 7 “companion 


Iatrix” 
一 02/01 一 03/01 …， 一 /dl 一 +H1/a1 
1 0 0 0 
A_| 0 1 0 0 
0 0 1 0 





to :证 C7 C1i+1 
元 下 平平 到 
CQ1 CQ1 Q1 


which is equivalentto P,(x)] = 0.Thusthe eigenvalues ofAarethe zeroes of P,(O.The 
eigenvalue method is robust but considerably slower than Laguerres method. 


- 


3.1 


3.2 





Numerical Differentiation 


Given the function 太 x, compute d7 JJ/dx"atgivenX 


Introduction 


Numerical differentiation deals with thefollowingproblem: we are given the function 
= 0 and wish to obtain one ofits derivatives atthe pointx = XIThe term given 
means that we either have an algorithm for computing the function，oTr possess a 
Set of discrete data points (2 切 ), = 1 2,..., 7. In either case, we have access to a 
fnitenumber of (x, J) datapairs from which to compute the derivative. 过 you Suspect 
bynow that numerical differentiation is related to interpolation, you are Tight- 一 one 
means offindingthe derivative is to approximate thefunction localybyapolynomial 
and then differentiate it. An equally effective tool is the Taylor series expansion of 
Jo aboutthe point xx. Thelatterhas the advantage ofproviding us with information 
about the error involved in the appIroximation. 

Numerical differentiation is not a particularly accurate process. It suffers fom 
a conflict between roundoff errors (due to limited machine precision) and errors 
inherent in interpolation. For this reason, a derivative of a function can never be 
computed with the same precision as the function itself. 


Finite Difference Approximations 


The derivation of the finite difference approximations for the derivatives of Fo are 
based on forward and backward Taylor series expansions of 帮 (x) about xz Such as 


7] 友 1 
JKT 月 = 了 7 四 十 凡 加 十 页 疡 四 二 页 大 的 十 而 广 加 十 … (al 
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刀 2 73 774 
诺 = 朋 = 的 三 胡 网 4 而 产 网 = 本 所 关于 帮 了 因 = ) 
WE NE RAW () 
2 甩 3 2 
Je- 功 = J 四 -2170+ | 0 因 一 …， 办 
Wealsorecord the sums and differences of the series: 
及 4 
J+ 月 + 7 月 =2700 二 天 产 0 十 刻 太 加 十 … (9) 
有 3 
x+ 万- xx 一 万 = 2j 广 四 十 可 疡 0 十 … 人 
2 P// 47124 (4) 
xz 二 2 六 十 Fr 2 六 一 2 十 4 了 加 二 本 了 ( 疝 幸 5 二 公 
尝 8723 AAA/ 
JEKT+T2-JG-2 区 =48 二 本 太 加 十 (hb) 


Note that the sums contain only even derivatives, while the differences retain just the 
odd derivatives. Equations (a)-(b) can be viewed as simultaneous equations that can 
be solved for various derivatives of /0. The number of equations involved and the 
number ofterms keptin each equation depend on the order ofthe derivative and the 
desired degree of accuracy. 


First Central Difference Approximations 
The solution of Eq. () for 广 (Co is 


万 一 一 月 天 
厅 网 三 CC 十 ) 训 国 


Keeping only the first term on the right-hand side, we have 


jx 十 月 一 /一 站 
2 








三 Co = 十 O(02) (5.1) 
which is called the jirst cezjQ1 dieremzce dpPP1oxi171101io1 for 广 00. The term O(12) 
reminds us that the truncation error behaves as 有. 

From Eq. (e] we obtain 


jx 二 月 一 2120 十 Jx 一 及 ， 


所 OO0 到 宏 


和 (同和 填 : 





OF 


jx 二 用 一 21 0 + 一 门 


二 OU G5.2) 


本 ( 河 二 
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Central difference approximations for other derivatives can be obtained ffom 
Eqs. (aj-(p) in a similar manner. For example, eliminating 广 (Co from Eqs. (上 and (hb) 
and solving for 广 “(x) yield 
FUx+2 帮 一 2Fx+ 有 十 27 一 有 万 -Fux--2 有 有 


+OUD 6.3) 





闻 0O0 二 


The approximation 
jx 二 2 甩 一 41x 二 月 十 6 一 41x 一 月 十 7Jx 一 2 站 





六 2 ( 交 二 十 OU2) (5 




















及 4 
is available from Eq. (e) and (8) after eliminating j 帮 (0. Table 5.1 summarizes the 
Iesults. 
jx 一 2 及 | jx 月 | OO | x+ 用 | x+2 丫 

27 广 0) 一 1 0 1 

天 记 网 1 一 2 1 

27123 00 一 1 2 0 一 2 1 

1 OO 1 一 4 6 一 4 1 
































Table 5.1. Coefficients of central finite difference appIroximations 
of O(12) 


First Noncentral Finite Difference Approximations 


Central fnite difference approximations arenotalways usable. For example, consider 
the Situation where the function is given at the 7 discrete points Xi, x2,. ,Xi Since 
central differences usevalues ofthe function on each side ofx we wouldbe unableto 
compute the derivatives at J and Xi. Clearly there is a need for finite difference 
expressions that Iequire evaluations of the function only on one side of x. These 
expressions are called fjorwaJd and packzwa1d finite difference appIoximations. 

Noncentral finite differences can also be obtained from Eqs. (aj-(b). Solving 
Eq. (a] for 广 (x) we get 





/ J xx 十 由 站 2) 刀 // 7 /1/ 帮 (4) 
三 0 = 万 的 一 于 矿 轩 一 页 厂 轩 
Keeping only the first term on the right-hand side leads to the ji7stjorwaT7a dzjjeremce 
CPPToxiI120G11O7 
X 十 站 一 Jrx 
三 河 二 下 1 下 十 O( 有 (5.5) 


Similarly Eq. (b) yields the jirst packIa1a dzjjeremce CPProxi7124io7 


0 -xc 一 月 
忆 


三 00 = 十 OO (5.6) 
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Note that the truncation error is nowO( 站 , which is not as good as the O(12) error in 
central difference appIoximations，. 

We can derive the appIoximations forhigher derivatives in the same manner. For 
example, Eqs. (a] and (c) yield 


jxT+2 有 一 271x 十 站 十 太 00 
太 2 





放 (0 二 





十 O( 门 05.7) 


The third and fourth derivatives can be derived in a similar fashion. The results are 
Shown in Tables 5.2a and 5.2b. 




































































Fo | + 用 | Fe+2 有 | Fe+3 甩 | Fr+4 站 
用 FO0) 定 1 
12 (00 1 2 1 
ja jp" | -1 3 一 3 1 
14 GO | 一 4 6 一 4 1 
Table 5.2a. Coefficients of forward finite difference approximations 
of O (万 
xx 一 4 站 | Fe-3 站 7-2 六 | 7 用 | OO 
PPO0 一 1 1 
7 户 (0) 1 三 1 
13 (0 | 3 3 1 
14 6( 1 一 4 6 一 4 1 
































Table 5.2b. Coefficients of backward finite difference appIoximations 
of O (万 


Second Noncentral Finite Difference Approximations 


Finite difference approximations of O(Pm are notpopular due to reasons that will be 
explained shortly The common practice is to use expressions of O(12). To obtain 
Doncentral difference formulas of this order we have to retain more terms in the 
Taylor series. As an iustration, we will derive the expression for 广 (0. We start with 
Eqs. (a] and (c, which are 


帮 2 刀 3 帮 4 
C++ 月 = Foo0 二 HRFoo 二 万 广 00 十 于 太 09 十 区 帮 ” ( 下 


3 4 
Je+2 有 六 = oO 二 27700 十 212 挛 (OO 十 NU 全 7 四国 +… 
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WwWeeliminate 广 (o bymultiplying the firstequation by4and subtracting it from the 
Second equation. The result is 


2 
FIxX+2 站 一 4Fx+ 有 万 = 一 3Foo0 一 27 关 0 十 亿 炙 由 + 





Therefore， 
上 2 
Po0 = Jox+2 有 十 4 月 一 3 加 六 十， 
27 3 
OLT 
网 十 Orgi 0G5.8) 





2 


Equation (5.8) is called the seco71G jorwa1a jzzite Gd 太 erezce CPProxi1720107. 
Derivation of finite difference appIoximations for higher derivatives involve 
additional Taylor series. Thus the forward difference appIoximation for 广 (o utilizes 
Selies for jx 十 帮 ，Fx+27 and jx+3m; the approximation for 太 “"(xo involves 
Taylorexpansionsfor 太 x 十 站 ,jx 二 2 站, jx+3 站 and jx 二 4Pm,etc.Asyoucansee， 
the computations for high-order derivatives can become rather tedious. The results 
for both the forward and backward finite differences are summarized in Tables 5.3a 




















and 5.3b. 
JJO0 | + 有 | +2 有 | x+3 六 | +4 有 | xc+5 门 
27F00 一 3 4 S 
12 六 2 一 5 4 一 1 
213 (0 一 5 18 一 24 14 一 3 
14 4 (0 3 一 14 26 一 24 11 一 2 
































Table 5.3a. Coefficients of forward finite diffterence approximations of O(12) 


















































JGx -5 用 | jx-4 站 | Fe-3 风 | xc=-2 甩 | xc 站 | Fo 

27 记 0Og 1 一 4 3 

12 六 一 1 4 一 5 2 

2713 (9 3 一 14 24 一 18 5 
14FGO0 一 2 11 一 24 26 一 14 3 





Table 5.3b. Coefficients ofbackward finite difference approximations of O(72) 
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Errors in Finite Difference Approximations 


Observe that in all fnite difference expressions the Sum of the coefficients is zero. 
The effect on the rox1zdofrerror can beprofound. 开 Pis verysmall thevalues of /0)， 
xx 土 内, jx 士 2m,etc.wilbe approximatelyequal. When they are multiplied bythe 
coeffticients in the finite difference formulas and added, several significantfgures can 
be lost. On the other hand, we cannot make 必 too large, because then the 厅 V72cC1iO7 
e1Tor would become excessive. This unfortunate situation has no remedy but we can 
obtain some relief by taking the following precautions: 


。 Use double-precision arithmetic. 
。 Employ finite difference formulas that are accurate to at least O(12). 


Toillustratethe errors, letus computethe second derivative of Fox 一 exatx 一 1 
from the central difference formula, Eq. (5.2). We carry out the calculations with Six- 
and eight-digit precision, using different values of 1. The results, shown in Table 5.4， 
should be compared with 六 () = el = 0.367879 44. 






































必 6-digit precision | 8-digit precision 
0.64 0.380 610 0.380 609 11 
0.32 0.371 035 0.371 029 39 
0.16 0.368711 0.368 664 84 
0.08 0.368 281 0.368 076 56 
0.04 0.36875 0.367 831 25 
0.02 0.37 0.3679 
0.01 0.38 0.3679 
0.005 0.40 0.3676 
0.0025 0.48 0.3680 
0.00125 1.28 0.3712 




















Table 5.4. (e- “atx= 1]1fromcentral fnite difference 
appIoximation 


In the six-digit computations, the optimal value of P is 0.08, yielding a result 
accurate to three significant fgures. Hence three significant fgures are lost due to 
a_ combination of truncation and roundofft errors. Above optimal 忆 the dominant 
elIror is due to truncation; below it the roundotff error becomes pronounced. The 
best result obtained with the eight-digit computation is accurate to four significant 
fgures. Because the extra precision decreases the roundoff error the optimal Pis 
Smaller (about 0.02) than in the Six-figure calculations. 


Numerical Differentiation 


3.3 


Richardson Extrapolation 


Richardson extrapolation is a Simple method for boosting the accuracy of certain 
numerical procedures, including finite difference appIroximations (we will also use 让 
later in numerical integration). 

Suppose that we have an approximate means of computing some quantity C. 
Moreover assume that the result depends on a parameter 有 . Denoting the appIoxi- 
mation byg( 由 ,wehaveG = 8 十 忆 ( 由 ,where 厂 (站 represents the error. Richardson 
extrapolation can remove the erromr provided thatithas the form 达 (及 =cpPcand 7 
being constants. We start by computing g( 有 六 with some value of 见 say 玉 = 太 . In that 
case we have 


G=8() 十 C11 国 
Then we repeat the calculation with 忆 = /2, so that 
G=8S(z2) 十 C712 0) 


Eliminating cand solving for C, we obtain from Eqs. iD) and (j) 


(my/ jpo)7g(o) -8 ) 


G 一 
(12a/ 712) 一 1 





(5.9a) 


whichisthe Ricpardso7z exbapolatio1jor7Uia.Itis commonpracticetouse 疡 = 太 /2， 
in which case Eq. (5.9a] becomes 


C 2Pg8(7/2) 一 8(7) 
加 25 二 





(5.9b) 


Let us jllustrate Richardson extrapolation by applying it to the finite difference 
appIoximation of (e-9" at XY = 1. We work with Six-digit precision and utilize the 
Iesults in Table 5.4. Since the extrapolation works only on the truncation error we 
must confine /to values that produce negligible roundofft. Choosing 太 = 0.64 and 
letting g(m be the approximation of 帮 (1) obtained with 克 we get from Table 5.4 


g(m) = 0.380610 g(1/2) = 0.371 035 





Thetruncation errorin the central difference approximation is 已 (万 = O(12) = ci72 : 
czj14 二 csj16 十 .…. Therefore, we can eliminate the first (dominanb error term 让 we 
Substitute Pp=2and 户 = 0.64in Eq. (5.9b). The result is 


CC- 22g(0.32) 一 g&(0.64) 4(0.371035) - 0.380610 


= 0.36784 
本 0.367843 





which is an approximation of (e-“ with the error O(1 坟 .Note thatitis as accurate as 
the best result obtained with eight-digit computations in Table 5.4. 
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EXAMPLE 5.1 
Given the evenly spaced data points 





访 0 0.1 0.2 0.3 0.4 
| 7 0.0000 | 0.0819 | 0.1341 | 0.1646 | 0.1797 





























compute 三 (0 and 广 (Oo atx=0and0.2 using finite difference appIroximations of 
O(2). 


solution From the forward difference formulas in Table 5.3a we get 





-3j 帮 0) 十 470.D -0.2) -3(0) 十 4(0.0819) -- 0.1341 














三 (0) = 200 一 0.967 
2j 丰 00) -5 太 0.1) 十 470.2) -70.3) 
三 (0) = 0 
2(0) -- 5(0.0819) 十 4(0.1341) -- 0.1646 
(0.1)? 
The central difference approximations in Table 5.1 yield 
一 0.D + 0.3) ”一 0.0819 十 0.1646 
三 (0.2) = 200 一 5 一 0.4135 
7 一 (0.1) -- 270.2) + 太 0.3) 大 0.0819 -- 2(0.1341) 十 0.1646 7 
(0.1)” (0.1)” 
EXAMPLE 5.2 


Use the data in Example 5.1 to compute 三 (0) as accurately as youU camn. 


solution One solution is to apply Richardson extrapolation to finite difference ap- 
pIoximations. We start with two forward difference appIoximations for 万 (0): one 
using 刀 = 0.2 and the other one using 疡 = 0.1. Referring to the formulas of O(P2) ip 
Table 5.3a, we get 


-3j 帮 0) 十 470.2) -0.4) 3(0) 十 4(0.1341) 一 0.1797 








g(0.2) = 3 = 0.8918 
soD= -3j0+470D 一 70o2 -3GO) 十 40.0819) 一 0.1341 _ 96r5 
2(0.]) 0.2 


where g denotes the finite difference approximation of 广 (0). Recalling that the erTor 
in both approximations is of the form 巨 (用 = cljp2 十 czj4 十 cs316 十 .…….，we can Use 
Richardson extrapolation to eliminate the dominant errorterm. With 六 = 2 we obtain 
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from Eq. (5.9) 


22g(0.0 -8(0.2) ”4(0.9675) -- 0.8918 
加 22 一 1 本 3 








广 (0) sCG 一 0.9927 


which is a finite difference approximation of O(014)， 


EXAMPLE 5.3 








The linkage Shown has the dimensions d = 100 mm = 120 mm c = 150 mm 
and 4 = 180 mm. It can be shown by geometry that the relationship between the 
angles ax and 6 is 


(d--dcosw 一 bcospB)2+(asinw 二 psnp) 一 c2 =0 


FEor a given value of w, we can solve this transcendental equation for 6 by one of the 
Ioot-fnding methods in Chapter 4. This was done with a = 0",5”", 10",...,30?, the 
Iesults being 





a (deg) 0 9 10 15 20 25 30 
8 ad) | 1.6595 | 1.5434 | 1.4186 | 1.2925 | 1.1712 | 1.0585 | 0.9561 






































Ilink 4B rotates with the constant angular velocity of 25 rad/s, use finite difference 
apprIoximations of O(j2) to tabulate the angular velocity db6/dtoflink BC against w. 


Solution The angular speed of BC is 
d6 


dp db6du 

人 
where db/da is computed from finite diffterence approximations usingthe data in the 
table. Forward and backward differences of O(jp2) are used at the endpoints, central 
differences elsewhere. Note that the increment of w is 


几 = (5deg) ( 


The computations yield 


5E3A(0) 十 48(5") - B(10?) 5 一 3(1.6595) 十 4(1.5434) -1.4186 
2 加 2 (0.087266) 





于 


10raddeg) = 0.087266rad 





有 00) = 2 
一 一 32.01 rad/s 
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5.4 


。 10?) 一 B(00? 1.4186 一 1.6595 
8Q0) 一 6807) _ 51L4186 











要 ee 2 一 一 34. 1 d 
瑟 2(0.087266) 
etc， 
The complete set of results is 
a (deg) 0 5 10 15 20 25 30 





(rad/s) |‖ -32.01 | -34.51 | -35.94 | -35.44 | -33.52 | -30.81 | -27.86 



































Derivatives by Interpolation 


I fo is given as a set of discrete data points, interpolation can be a very effective 
means of computing its derivatives. The idea is to approximate the derivative of 矿 20) 
bythe derivative ofthe interpolant.Thismethodisparticularlyusefulifthe datapoints 
are located at uneven intervals of zx when the finite difference approximations listed 
in the last article are not applicable.? 


Polynomial Interpolant 
The idea here is simple: fitthe polynomial of degree 刀 一 1 
Pa1O0 = QiX 十 0 十 十 男 (9) 


through 2 data points and then evaluate its derivatives at the given xz. As pointed out 
in Art. 3.2, it is generally advisable to limit the degree of the polynomial to less than 
Six in order to avoid spurious oscillations of the interpolant. Since these oscillations 
are magnified with each differentiation, their effect can be devastating. In view of the 
above limitation, the interpolation should usually be a local one, involving no more 
than a few nearest-neighbor data points. 

FEor evenly spaced data points, polynomial interpolation and finite difference 
appIoximations produce identical results. Im fact the finite difference formulas are 
equivalent to polynomial interpolation . 

Several methods ofpolynomial interpolation were introduced in Art. 3.2. Unfor- 
tunately none ofthem is suited for the computation of derivatives. The method that 
we need is one that determines the coefficients qd , 0,.. ,hr of the polynomial imp 
Eq. (aj. There is only one Such method discussed in Chapter 3 一 the /edst-S9UQT1es 四 
Although this methodis designedmainlyfor smoothing ofdata, it will carry out inter- 
polation iweuse710=7 inEqd. (3.22).Ifthe data contains noise, then theleast-squares 
ft should beusedin the smoothing mode, thatis, with 1 <7. After the coefcients of 


9 Itis possible to derive finite difference approximations for unevenly spaced data, but they would 
notbe as accurate as the formulas derived in Art. 5.2. 
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the polynomial have been found, the polynomial and its first two derivatives can be 
evaluated efficiently by the function evalpoly jlisted in Art. 4.7. 


Cubic Spline Interpolant 


Due to its stifftness, cubic spline is a good global interpolant; moreover it is easy to 
differentiate. The first step is to determine the Second derivatives 态 of the spline at 
the knots by solving Eqs. (3.12). This can be done with the function splineCurv as 
explained in Art. 3.3. The first and second derivatives are then computed from 














后 [3(G 一 +? 
大 H10O0 = | 击 二 芍 洒 06 一 Xi+H1) 
矿 3(XK 一 冶 )? 一 芒 
| SS ] (G5.10) 
6 【和 一 和 +1 始 一 妈 +1 
龙 一 好 上 +1 泌 一 好 
一 态 乒 5.] 1 
有 2 
which are obtained by differentiation of Eq. (3.10). 
EXAMPLE 5.4 
Given the data 
洗 .5 1.9 乙 汪 2.4 2.6 3.1 
































JJ ‖ 1.0628 | 1.3961 | 1.5432 | 1.7349 | 1.8423 | 2.0397 





compnute 三 2) and j 太 (2) using (1 polynomial interpolation over three nearest- 
neighborpoints, and (2) natural cubic spline interpolantspanningall the datapoints,. 


solution of Part (1) Letthe interpolantpassingthroughthepointsatx = 1.9,2.1and 
2.4be P>(00 = al + 02X 十 03t2.Thenormalequations,Eqs.(3.23),oftheleast-squares 
fit are 


有 开 帮 工 生 | | aa 2 入 
= hi 
并 好 夺 交 工 和 | Las 守 世 好 


After substituting the data, we get 


3 6.4 13.78 01 4.6742 
6.4 13.78 “29.944 02 | 三 | 10.0571 
13.78 29.944 65.6578 03 21.8385 
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了 
Which yields a == | -0.7714 1.5075 -0.1930| . Thus the interpolant and its deri- 
vatives are 


已 (0 = -0.1903x2 十 1.5075x 一 0.7714 
(Oo = 一 0.3860x 十 1.5075 


疡 (0 = 一 0.3860 
Which gives us 


PC] = 尼 C) = -0.3860(2) + 1.5075 = 0.7355 
六] = 必 (C2) = -0.3860 


solution of Part (2) We must first determine the second derivatives 态 of the spline 
at its knots, after which the derivatives of /zx can be computed from Eqs. (5.10) and 
(5.11). The firstpart can be carried out by the following small program: 


% EXample 5.4 (Curvatures of cubic splLine at the knots) 
头号 三 下 荆 5 了 297 二 25 2867 35 

YData = [1.0628; 1.3961; 1.5432; 1.7349; 1.8423; 2.0397]; 
Kk = SplLineCurvCxData,yData) 


The output of the program, consisting of 6 to 司 , is 


>> Kk = 
0 
-0.4258 
-0.3774 
-0.3880 
-0.5540 
0 


Since Xx = 2 lies between knots 2 and 3, we must use Eqs. (5.10) and (5.11) with 
1 = 2. This yields 








名 「3GC 一 32) 
三 2)] = 万 3(2) = 6 | 入 二 二 WOa 加 
一 2 一 
1a 车 各 ) 证 加 量 六 一 蕊 
6 X2 一 娄 一 人 炮 
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2 E 2 
_ 一 0.4258) [3 一 2 
6 (一 0.2) 
(一 0.3774) 「3(2 一 1.9)2 区 6 本 1.3961 - 1.5432 
6 (一 0.2) 下 (一 0.2) 
= 0.7351 
光一 : 炎 了 炎 一 泌 2 
A/ 忆 之 1 2 二 于 玉 
三 (2) 2.3(2) 2X2 一 X3 3X2 一 3 
2=2.1 2.=19 
= (-0.4258) 二 一- -~ (-0.3774) 一 一 = -0.4016 





(一 0.2) 


are 三 (2) = 0.7358 and j 太 (2) = 一 0.3679. 


(一 
Notethatthe solutions for 广 2) in parts (1) and (2) differ onlyin thefourth sign 育 cant 
fgure,butthevalues of 六 (2) are much farther apart. This is notunexpected, consid- 
ering the general rule: the higher the order of the derivative, the lower the precision 
with which it can be computed. It is imnpossible to tell which of the two results is 
better without knowing the expression for /0. mm this particular problem, the data 
points fall on the curve Fo = X2e-Y2, so that the“correct” values of the derivatives 


0.2) 

















EXAMPLE 5.5 
Determine 万 (0) and 广 (1) from the following noisy data 
区 0 0.2 0.4 0.6 
J 厂 0 1.9934 | 2.1465 | 2.2129 | 2.1790 
元 0.8 1.0 1.2 1.4 
Jo0 2.0683 | 1.9448 | 1.7655 | 1.5891 


























solution We used the program listed in Example 3.10 to find the bestpolynomial fit 


(in the least-squares sense)j to the data. The resujlts were: 


degree of polynomial = 
Coeff = 
-7.0240e-001 
6.4704e-001 
2.0262e+000 
SIgma = 
3.6097e-002 


degree of polynomial = 
coeff = 
4.0521e-001 


2 


3 
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-1.5533e+000 
1.0928e+000 
1.9921e+000 

SIgma 
8.2604e-003 


degree of polLlynomial 4 


Coeff 


当下 
4. 
茹 | 
站 


5329e-002 
4813e-001 
5906e+000 


.028e+000 


1.9919e+000 
SIgma 
9.5193e-003 


degree of polLlynomial 


Done 


Based on standard deviation, the cubic seems to be the best candidate for the 
interpolant. Before accepting the resulb we compare the plots ofthe data points and 
the interpolant 一 see the figure. The fit does appear to be satisfactory. 





J 0 





有 











和 上-- 
定 


1.40 


大 


Approximating 太 oo0 by the interpolantb we have 
Fo = 1X3 十 Ga2X2 十 03X 十 ( 才 
So that 


Oo0 = 3aiX2 十 202X 十 03 
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Therefore， 


(0) = as = 1.093 


广 d) = 3al 二 2a2 十 03 = 3(0.405) 十 2( 一 1.553) 十 1.093 = 一 0.798 





In general derivatives obtainedfrom noisy data are atbestrough appIoximations. 


In this problem, the data represent 太 x) = (X 十 2)/coshx with added random noise. 
Thus 广 (0 = [1 一 (KK 十 2)tanh 刘 /coshx, So thatthe correct" derivatives are 三 (0) 一 
1.000 and 广 () = 一 0.833. 


PROBLEM SET 5.1 





] 


Given the values of 丰 oo0 at the points z X = 有 andx 十 万 ,determine the finite 
difference approximation for 矿 (o. What is the order of the truncation erToT? 


.Given the first backward finite difference approximations for 广 (OO and 广 (0， 


derive the first backward finite difference approximation for 广 "(xo using the op- 


eration 六 (Co = |[ 六 OO] . 


.Derive the central difference approximation for 六 (CO accurateto O(1 byapply- 


ing Richardson extrapolation to the central difference approximation of O(P2). 


.Derive the second forward finite difference approximation for j 帮 “(x) from the 


Taylor series，. 


. Derive thefirst central difference appIoximation for 矿 (0 from the Taylor series. 


.Use finite difference approximations of O(jp2) to compute 六 (2.36) and (2.36) 


位 om the data 





万 2.36 2537 2.38 2.39 
Jo | 0.85866 | 0.86289 | 0.86710 | 0.87129 





























. Estimate 万 IJ) and 太 () from the following datal: 





区 0.97 1.00 1.05 
Jo | 0.85040 | 0.84147 | 0.82612 


























.Given the data 





艺 0.84 0.92 1.00 1.08 1.16 
Jo) 上 0.431711 | 0.398519 | 0.367879 | 0.339596 | 0.313486 
































calculate j 太 (]) as accurately as you camn. 
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季 


10. 


站 


]2， 


13. 


Use the data in the table to compute 三 (0.2) as accurately as possible. 





浆 0 0.1 0.2 0.3 0.4 
Jo ‖0.000000 | 0.078348 | 0.138910 | 0.192916 | 0.244981 
































Using five significant fgures in the computations, determine d(sin z)/dx at X 一 
0.8 from (a) the first forward difference appIroximation, and (b) the first central 
difference approximation. In each case, use 妃 that gives the most accurate ITesult 
(this requires experimentation). 


国 USe polynomial interpolation to compute 广 and 广 atx=0,usingthe data 





演 会 和 人 一 0.3 0.8 .9 
Jo ‖ 15.180 | 10.962 | 1.920 | 一 2.040 



































The crank 4B oflength 尺 = 90 mm is rotating at the constant angular Speed of 
cd0/dti= 5000rev/min.The position ofthe piston C canbeshownto vary with the 


angle0 as 
X 一 玉 (coss 十 V2.52 一 si ) 


Write a program that computes the acceleration of the piston at 0 = 
0",5", 10",...，,180"” bynumerical differentiation . 
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Theradar stations 4and B, separated bythe distance 4 = 500 my trackthe plane 
C by recording the angles wx and pb at one-second intervals. If three Successive 
readings are 





1 (S) 9 10 11 
CQ 54.80”| 54.06”| 53.34” 
有 65.59”| 64.59”| 63.62” 
































calculate the speedyv of the plane and the climnb angle y att= 10 S. The coordi- 
nates of the plane can be shown to be 


tan tanoatan 有 


tan8 一 tanw tanpb 一 tana 


14.， 力 






Dimensions 190 
in mm 





Geometric analysis of the linkage shown resulted in the following table relating 
the angleso and 6p: 





0 (deg) 0 30 60 90 120 150 
B (deg) | 59.96 | 56.42 | 44.10 | 25.72 | -0.27 | 一 34.29 



































Assuming that member 4B of the linkage rotates with the constant angular ve- 
locity do/dt= 1rad/s compute db]/dtin rad/s at the tabulated values of 0. Use 
cubic spline interpolation . 


IIATLAB Functions 


d = diff(y) returns the differences da(i) = y(Ci+l) - y(Ci)，Note that 
ength(d) = LengthCy) - 工 . 
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dn = diff(Gy,n) returns the th differences; e.g.，dqd2(i) = d(Ci+l) - d(Ci)， 
d3(I) = qd2(i+1l) - qd2(Ci),etc.Here Jength(Cdn) = LengthCy) - nm. 

d = gradient(y,h) returns the finite difference approximation of dJ/dx at each 
poinb where h is the spacing between the points. 


da2 = del2(Cy,h)returnsthefinite difference approximation of(d2J/dx2)/4ateach 
point whereh is the spacing between the points. 


6 


6.1 





Numerical Integration 


Compute 岂 JJ dz where 太 oO is a given function 


Introduction 


Numerical integration, also known as quad1atzye, is intrinsically a much more accu- 
rate procedure than numerical differentiation. Quadrature appIoximates the definite 
integral 


六 
1 Jo dx 


by the sum 
T= 2 4ijoo) 
记 1 


where the 1odC1CBpscissasw and WeigPpxN 4 dependontheparticularrule usedforthe 
quadrature. All rules of quadrature are derived from polynomial interpolation ofthe 
integrand. Therefore, they work best 让 太 x) can be approximated by a polynomial. 

Methods ofnumericalintegration can be divided into two groups: Newton-Cotes 
formulas and Gaussian quadrature. Newton-Cotes formulas are characterized by 
equally Spaced abscissas, and include well-known methods such as the trapezoidal 
rule and Simpsons rule. They are most useful 让 /oo has already been computed at 
equal intervals, or can be computed at low cost. Since Newton-Cotes formulas are 
based on local interpolation, they reduire only a piecewise fit to a polynomial. 

In Gaussian quadrature thelocations ofthe abscissas are chosen to yield the best 
possible accuracy Because Gaussian quadrature Tequires fewer evaluations of the 
integrandfora given level ofprecision,itispopularin cases where 让 2x) is exzpensive to 
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6G.2 


evaluate. Another advantage of Gaussian quadrature is its abjlity to handle integrable 
Singularities, enabling us to evaluate expressions Such as 





1 
S() 
地 
人 V] 一 3 则 


provided that g(oO is a well-behaved function. 


Newton-Cotes Formulas 





1 PH(M 
- 

全 | | Figure 6.1. Polynomial approximation of 矿 20. 

IN 

MY Xn-1 Xp 

| 六 
Consider the definite integral 

忆 
1 J0 dx (6.1) 
G 


We divide the Iange of integration (中 into 即 一 1 equal intervals of length 于 == 
(2 一/(0- 1 each, as shown in Fig. 6.1, and denote the abscissas of the resulting 
nodes by ,z2,.…. ,Xi.Nextwe appIoximate 帮 (xz) byapolynomial ofdegree 妈 一 1that 
intersects all the nodes. Lagranges form ofthis polynomial Eq. (3.1a), is 


有 


Pi00 = 》, oa)Ei0g 
记 1 
where 刀 io are the cardinal functions defined in Eq. (3.1b). Therefore, an approxima- 
tion to the integral in Eq. (6.1) is 


万 7 万 用 
T= ) Piz= | 7 | cmdr| = Oo (6.2a) 


1 一 1 下 


where 
万 
Ai 过 | CO0dx， 7 一 12,... ,7 (6.2b) 
如 


Equations (6.2) are the Newiom-Cotes jo777U10s. Classical examples of these formu- 
las are the 1rCpezoidal TUIe (7 一 2)，S112108So18 TUIe (1 一 3) and 9117121so18S 3/18 TU1e 
(1 一 4.The mostimnportant ofthese is the trapezoidal rule. It can be combined with 
Richardson extrapolation into an ef8icient algorithm known as Ro72perg ?1e87atio7， 
which makes the other classical rules somewhatredundant. 
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Trapezoidal Rule 


帮 X0) 一 
| 


Figure 6.2. Trapezoidal rule. 








开 刀 一 2, wehavetll= (一 和 2)/00 一 和 2) = 一 KK 一 站/ 几 Therefore， 











下 1 国有 
4 = 下 (一 和 dx = 元 册 一 
Also ta = (KK 一 妈 )/(z2 一 为 ) = (一 四 /及 Sothat 
本 总 1 ) 刻 
42 一 / 途 四 民 = 考 也 0) 三 
Substitution in Eq. (6.2a) yields 
忆 
TI=[/ 四 +JDI5 (6.3) 


which isknown asthe Cpezoida17u1e.Itrepresentstheareaofthetrapezoidin Fig.6.2. 
The error in the trapezoidal rule 


刀 
Re JoOdx 一 了 


is the area of the region between /zx) and the straight-line interpolantb as indicated 
in Fig. 6.2. It can be obtained by integrating the interpolation error in Eq. (4.3): 





1 /2 1 万 
二 二 了 CC 一 2 一 2) 广 G)Gx = zj |/ CC 一 ad 一 门 dx 


三 四 一 丰产 向 = 一生 三) (6.4) 
尖 二 和 党 二 计 


Composite Trapezoidal Rule 


| | 
1 
| | 
ES Figure 6.3. Composite trapezoidal rule. 
| 
| 


jx) 





203 | 6.2 Newton-Cotes Formulas 


In practice the trapezoidal rule is applied in apiecewise fashion. Figure 6.3 Shows 
the region (a, 六 divided into 兄 一 1 panels, each of width 及 The function 太 x to be 
integrated is appIoximated by a straightjline in each panel. From the trapezoidal rule 
we obtain for the approximate area of atypical (ith) panel 


用 
五 三 [Joc) + Foc3D)] 了 


Hence total area, TepIesenting 人 Jo dx is 


7 一 1 


TI= >》 五 = [fo 二 210o) 十 206) 十 十 270o-D + Joo] 


下 


(6.5) 


已 | 并 


Which is the co17Posite 1rapezoidalL TUIe. 
The truncation error in the area ofa panel is from Eq. (6.4)， 


友 A/ 
忆 = 三 十 小 (5 


where 5i lies in (2,X+1). Hence the truncation error in Eq. (6.5) is 


了 = 记忆 = 一 蕊 2 万全 () 
三 1 


But 

天 = 

>》 有 万 乓 = (一世 

记 1 
where 户 isthearithmeticmean ofthe second derivatives.If 户 (C0O is continuous,there 
mustbeapointsin (Q, 站 atwhich 广 () = 友 enabling us to write 





1 一 1 万 
挛 国 一 天国 = 一 广 鸭 
记 1 
Therefore, Eq. (a] becomes 
太一 四 1 
2=- 一 了 人) (6.6) 


Itwouldbe incorrectto conclude from Eq. (6.6) that 己 = cjp2 (cbeingaconstant)， 
because 六 (G) is notentirelyindependent of 几 A deeper analysis of the errorl0 shows 
that 计 帮 z0 and its derivatives are finite in (Q, 思 , then 


已 = cl12 十 cz 天 十 cs 十 …: (6.7) 


10 The analysis requires familiarity with the Bue1er 六 MaclaxTiz su7272Cfio7m jprmzuia, which is covered 
in advanced texts. 
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Recursive Trapezoidal Rule 


Let 及 betheintegral evaluated with the composite trapezoidal rule using 2 扩 : panels. 
Notethat 让 Kis increasedbyone,thenumber ofpanelsis doubled. Usingthenotation 


五 =D 一 4 
we obtain from Eq. (6.5) the following results forK= 1,2 and 3. 
上 一 1 (1panel): 
万 
五 = [Fo + 大] 订 (6.8) 
上 一 2(2panels): 


五 = | 7 四 +27(a+ 到 )+7 四 | 全 = 了 +7(a+ 全 ) 


上 一 3(4panels): 


妃 妃 民 妃 
亢 兰 |7a+27(a+ 全 )+27(a+ 了 )+27(a+ )+7 四 | 
1 刀 3 克 \ | 五 
天 52+| 7 人 (e+ 达 )+7(a+ 于 | 
We can now seethatfor arbitraryK 上 > 1 we have 
1 九 所 (Ci 一] 万 
5 3 | 友 二 2 355 (6.9a) 
1 一 


which is the 7eczTsive 1apezoidal uie. Observe that the Summation contains only 
the newnodes that were created when thenumber ofpanels was doubled. Therefore， 
the computation ofthe sequence 厂 , 卫 , 厂 ,….., 玲 fomEqs.(6.8) and (6.9) involves the 
same amount ofalgebra as the calculation of 太 directly from Eq. (6.5). The advantage 
ofusing the recursive trapezoidal rule is that it allows us to monitor convergence and 
terminate the process when the difference between 太 _1l and 有 becomes sufficienty 
Small.Aform ofEq. (6.9a) that is easier to remember is 


1 
1 内 = IC 用 十 尹 2 Conew) (6.9b) 


where 玫 = 互 /(2 -JU is the width ofeach panel. 


国 世 apezolid 





The function trapezoid computes T( 万 ,given 7(2 万 位 om Eqs. (6.8) and (6.9). We 
can compute Jo dx by calling tzrapezoid repeatedly with 大 = 1,2,... until the 
desired precision is attained. 
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function Ih = trapezolid(Cfunc,a,b,I2h,K) 

% Recursive trapezoidal Tule . 

% USAGE: Ih = trapezolid(Cfunc,a,，b,I2h,K) 

% func = handle of function being :Integrated . 
% ab = ]1imits of :integtration . 

% I2h = integral with 2”`(k-1) Panels . 

% Ih = :integral with 2 Kk panels . 


If K == 
fa = feval(Cfunc,a); fb = feval(Cfunc,b)i; 
Ih= (fa + fb)*(Gb - a)/2.0; 


ese 
nn= 2 (K -2 ); % Number of new points 
h=(b- al)mn ; % Spacing of new Points 
又 = aa+hX2.0; % Coord. of 1st new poinmnt 
Sum = 0.0| 


fomz 工 = 工 :mn 
fx = fevalLl(Cfunc ,和 X) ; 
Sum = Sum 二 xi; 
区 -三 莹 汪 王 : 

end 

Ih = (I2h + hxsum)/2.0; 


end 


Simpson's Rules 





| 
| 
E Figure 6.4. Simpsons 1/3 rule. 
| 
| | 
1 | 上] 
X1= 卫 X2 和 允 =5 


Si111Sso1S 1/3 Fuie can be obtained from Newton-Cotes formulas with 刀 = 3; 
thatis, bypassingaparabolic interpolant through three adjacent nodes, as shown in 
Fig.6.4.Theareaundertheparabola,which representsanappIroximation of 友 J0 Gd 
is (see derivation in Example 6.1) 


I=|7@+4r(S)+7m|5 (9 
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jx 
2 
| 
用 十 - 旋 
上 | | Eigure 6.5. Composite Simpsons 1/3 rule. 
| | 
1 | 





To obtain the co1jposite S1121pso1S 1/3 Tuie, the integration range (ad, 站 is divided 
into 7 一 1 panels (2 odd of width 克 = (2 一 /2 -了 each, as indicated in Fig. 6.5. 
Applying Eq. (a) to two adjacent panels, we have 


Xi 上 +2 矿 
1/ jmix= LoD+41oorD+ oal15 ) 


Substituting Eq. (b) into 


7 一 2 


忆 2 JiH+2 
1 Jaou= / 三 0 dx = | Jar| 


3 


yields 


也 
1 J00dxzsT= [Joa) 二 40) 十 2708) 十 4 十 … (6.10) 


万 
三 2 帮 20 >) 十 4 1) 寺 J Co] 了 


The composite Simpsons 1/3 rule in Eq. (6.10) is perhaps the best-known method of 
numerical integration. Its reputation is somewhat undeserved, since the trapezoidal 
Iule is more Iobust and Romberg integration is more efficient. 

The error in the composite Simpsons rule is 


人 一 可 1 
用 汪 6.11 
180 三 ) (6.1D) 
from which we conclude thatEq. (6.10) is exact 计 帮 x is apolynomial of degree three 


oOT less. 

Simpsons 1/3 rule requires the number of panels to be even. Ithis condition is 
not Satisfied we can integrate over the first (or last) three panels with 91772jDso1s 3/18 
Te: 


3 
了 = [Joo) 二 3Joeo) 二 30oa) 十 Jo] 可 (6.12) 


and use Simpsons 1/3 rule for the remaining panels. The error in Eq. (6.12) is of the 
Same order as in Eq. (6.10). 


EXAMPLE 6.1 
Derive Simnpsons 1/3 rule from Newton-Cotes formulas. 


6.2 Newton-Cotes Formulas 


solution Referring to Fig. 6.4, we seethat Simpsons 1/3 rule uses threenodes located 
at 一 0, 和 =(4 二 有 /2 and 台 = 已 The spacing ofthe nodes is 天 = (一 人/2.The 
cardinal functions ofLagranges three-point interpolation are (See Art. 3.2) 


(一 和 2)(X 一 区) (一 妈 )( 人 一 和 ) 
《1 ( 品 三 人 2 oo = 三 
(1 一 如) 一 和 ) (2 一 和 加) 一切 ) 








示 一 加)(X 一 交 ) 
在 0 三 
WOa 一 和 加)0OG 一 交 ) 
The integration ofthese functions is easier 让 we introduce the variable 5 with origin 
at 和. Then the coordinates of the nodes are 5 = 一 凡生 一 0 53 = 六 andEq. (6.2b) 


becomes 4 = 户 2i00dx = 六 生 乓 小 .Therefore， 

















人 0 未 人 人 一 由 ) 必 一 
-三 四 1 已 二 - 最 呈 区 二 二 和 
4 
Equation (6.2a)] then yields 
二 一 有 Jo6) = [ya +47( 2 平 /mg| ， 


which is Simpsons 1/3 rule. 


EXAMPLE 6.2 
Evaluate the bounds on 放 Sin(x) dx with the composite trapezoidal rule using (]) 
eight panels and (2) sixteen panels. 


solution of Part (1) With 8 panels there are 9nodes spaced at 灵 = 式 /8.The abscissas 
ofthenodes are 万 =( 一 Jr/8，7=1,2,...,9.From Eq. (6.5) we get 


8 ， 
7 元 元 
T 一 |sin0 十 2 Sin 一 十 Sin 一 一 1.97423 
| +2 交 sm 区 + = 


The error is given by Eq. (6.6): 


石 一 四 及 一 0 8)” 元 3 
忆 = 一 人 -2 一 -一 一 太 G) = 区 LO sinE) 一 068 Sin 


where 0 < 所 < 交 .Since we do notknowthe value of we cannotevaluate 已, but we 
can determine its bounds: 


元 3 3 


元 5 
王 寺 南 三 5 sin(0) 一 0 所 而 二 三 768 Sin 亲 一 0.040 37 
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Therefore, 了 十 Bnin < 丰 sin(xo dx < 了 工 十 BEmax, OFT 
1.97423 一 1 Sin(xX) Cx < 2.01460 
0 


The exact integral is, of course, 了 = 2. 


solution of Part (2) The new nodes created by the doubling ofpanels are located at 
midpoints ofthe old panels. Their abscissas are 








元 ， 元 元 
羽 = 下 十 DB 一 (7 Djig， 2 


Using the recursive trapezoidal rule in Eq. (6.9b), we get 
诺 23 ， 元 .二 了 
了 二 一 一 1.99358 
+ 


and the bounds on the error become (note that BE is quartered when P is halved) 
PEnmin 一 0,，BEnmax = 0.04037/4 = 0.010 09. Hence 


1.993 58 < 上 Sin(X) dx < 2.003 67 
0 


EXAMPLE 6.3 
Estimate 人 Fo dx from the data 





大 0 0.5 1.0 1.5 2.0 2 
Jo | 1.5000 | 2.0000 | 2.0000 | 1.6364 | 1.2500 0.9565 | 
































solution We will use Simpsons rules, since they are more accurate than the trape- 
Zoidal rule. Because the number of panels is odd, we compute the integral over the 
first three panels bySimpsons 3/8 rule, anduse the 1/3 rule for the last two panels: 


T= [FlO+3Fo.5+370.0+ Fa.5)] 了 
十 [FG.5) 上 +4F(2.0) 十 并 员 。 加 
一 2.8381 十 1.2655 = 4.1036 
EXAMPLE 6.4 


Use the recursive trapezoidal rule to evaluate 中 VXZcosxdax to six decimal places. 
How many function evaluations are required to achieve this result? 


solution The program listed below utilizes the function trapezoid.Apart from the 
value of the integral it displays the number of function evaluations used in the 
computation. 


209 | 6.2 Newton-Cotes Formulas 


% EXample 6.4 (Recursive trapezoidal rule) 
format ong % Display extra preciIsion 
工 2 上 -三 03 
for K = 1:20 
Ih = trapezoidCQfex6_4,0,pI,I2h,K); 
if (k> 1& abs(Ih - I2h) < 1.0e-6) 
Integral = Ih 
No_of_func_evaluations = 2”(Kk-1) + 工 
Teturmn 
end 
工 2 五 三 工 菩 ; 
end 


erTror( "Too many Iterations ') 
The M-fle containing the function to be integrated is 


function Yy = fex6_4(X) 
% Function used :in Example 6.4 


Yy = Sqrt(CX)x*cos(X) ; 
Here is the outpnut: 


>> Integral = 
-0.89483166485329 
No_of_func_evaluations = 
32769 


Rounding to six decimal places, we have 太 VXcosxdx = 一 0.894832 

The number offunction evaluations is unusually large in this problem. The Slow 
convergence is the result of the derivatives of jx) being singular at X = 0. Conse- 
quently the error does not behave as shown in Eq. (6.7): 已 = clj12 + cz14 十 .butis 
unpredictable. Difficulties of this nature can often be remedied by a change in vari- 
able. mm this case, we introducet = VX, sothatdf= dx/( 2 = Gdx/(2nD,oradx = 21GL 
Thus 


工 VI 
| \VXcosXax 二 1 22 cos 妇 d 
0 0 


Evaluation of the integral on the iight-hand side would require 4097 function 
evaluations. 
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6.3 


Romberg Integration 
Romberg integration combines the composite trapezoidal rule with Richardson ex- 
trapolation (See Art. 5.3). Let us first introduce the notation 

有 1 三 天 


where, as before, 石 represents the appIroximate value of 尼 Jo0dx computed by the 
recursivetrapezoidalruleusing22 一 1 panels.Recallthattheerrorin this approximation 
is 瑟 = cl12 十 cz14 十 .where 





is the width of a panel. 

Romberg integration starts with the computation of Ri 1 = 厂 (one panel and 
Roll 一 了 (two panels) from the trapezoidal rule. The leading error term cl712 is then 
eliminated by Richardson extrapolation. Using 疡 = 2 (the exzponentin the error term) 
in Eq. (5.9) and denoting the result by Rz > we obtain 

2 
。 2 和 一 Ra 了 及 (al 


It is convenient to store the resujlts in an array of the form 


有 al 
fl > 


The next step is to calculate ms 1 = (fourpanels) and repeat Richardson extra- 
polation with Rzl and Ral, Storing the result as Ra >: 


1 = 





4 1 
Fa = 一 Ra 一 = 民 b 
32 二 51 一 3 了 :1 (b) 
The elements of arrayR calculated so far are 
1 
21 2 
Ra Ra2 


Both elements of the second column have an error of the form cz 凡 , which can also 
be eliminated with Richardson extrapolation. Using 户 = 4ipn Eq. (5.9), we get 


22Ra> 一 RP 16 1 


3.3 24 一 了 语 中 2 2,2 (9) 





有 1 
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After anotherround of calculations we get 


al 

PR21 2 

Ra Ps Rs 
R41 R42z R4sas Ra44 


where the error in Ra is O(18). Note that the most accurate estimate ofthe integral 
is always the last diagonal term ofthe array. This process is continued until the differ- 
ence between two successive diagonal terms becomes sufficiently small. The general 
extrapolation formula used in this scheme is 
/-1 
尼 ) 一 2 二 (6.13al 
Apictorial representation of Eq. (6.13a) is 











及 -1 广 1 








AN 
Q (6.13b) 


AN 


及 ji 一 有 8 一 | 肠 ) 


























where the multipliers w and 8 depend on j in the following manner: 





J | 2 3 4 5 6 


oa | -1/3 -1/15 -1/63 -1/255 ”一 1/1023 (6.13c) 
8 | 4/3 16/15 64/63 256/255 “1024/1023 




















The triangular array is convenient for hand computations, but computer imple- 
mentation of the Romberg algorithm can be carried out within a one-dimensional 
arayr. After the first extrapolation 一 See Eq. (9) 一 Rail is never used again, So that 让 
can be replaced with R2 >. As aresult we have the arTay 


广 三 了 > 
疡 = 了 恬 1 


In the second extrapolation round, defined by Eqs. (b) and (c)，Rs > overwrites PR 1 
and Rss Ieplaces PR > So thatthe array now contains 


方 一 as3 
疡 = 必 > 
7m3 = al 


andso on.Imthis manner malways contains the best currentresult. The extrapolation 
formula for the kth round is 
_ 4 一 疙 


太一 1 =K 一 1K 一 2,...,1 (6.14) 
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国 OombeTrg 


The algorithm for Romberg integration is implemented in the function romberg. It 
Ieturns the value of the integral and the required number of function evaluations. 
Richardsons extrapolation is performed by the subfunction richardson. 


function [I,numEval] = Yomberg(Cfunc,a,b,tol,KkMax) 
% Romberg integration . 
% USAGE: [I,numEval] = Yomberg(Cfunc,a,b,tol,KkMax) 


% INPUT : 

% func = handle of function beling :integrated . 

% ab = imits of :integration . 

% 七 oO = error tolerance (default is 1.0e-8) . 

% KMaxX = Jimit on the number of panel doub1lings 
% (default Is 20) . 

% OUTPUT : 

% 工 = Value of the :Integral . 


”% numEval = number of function evaluations . 


If mnargin < 5; kMax = 20; end 
If narglin < 4; tol = 1.0e-8; end 
z = Zeros(CKMaxX) ; 
二 区 ] 
天 O 下 可 天 < 二 
for K = 2:KMaxX 

TY(k) = trapezoid(Cfunc,a,b,zCK-1) ,K) ; 

五 三 :下 玫 amUSORKCE3 7 

If abs(T(1) - TO01d) < tol 

DumEval = 2”(Kk-1) + 1; 工 = (1); 


工 GtUI 


tapezolidCfunc,a,b,0,1L); 


end 
五 O 工 由 三 ::( 人 (了 
end 


error( "Failed to converge ') 


function TY = TIchardson(Cz ,K) 
% Richardson'"s extrapolation :in Edq. (6.14) . 
for j = K-1:-1:1 
C = 4 (k-J); TGJ) = (cxrT(J+1) - ICJ))VCc-I1) ; 
emnd 
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EXAMPLE 6.5 
Showthat Rin Rombergintegration is identicalto the composite Simpsons 1/3 rule 
in Eq. (6.10) with 2 上 panels. 


solution Recall that in Romberg integration Ri = 到 denoted the approximate in- 
tegral obtained by the composite trapezoidal rule with 2: panels. Denoting the 
abscissas of the nodes by 和 , 妇 ,.….,Xo we have from the composite trapezoidal rule 
in Eq. (6.5) 


7 一 1 1 六 
且 1 = 丈 = [mm 十 2 》, oa) 十 37oo| 了 
1 一 2 


When we halve the number of panels (panel width 2 乞 , only the odd-numbered ab- 
Scissas enter the composite trapezoidal rule, yielding 


1 一 2 
用 1 [mm 十 2 方 。 J06) 十 1 忆 


证 3.555 


Applying Richardson extrapolation yields 


4 1 
Ri = 一 了 RE Il 


号 3 
了 | 
国 3 3 纪 . 人 


which agrees with Simpsons rule in Eq. (6.10). 


EXAMPLE 6.6 
Use Romberg integration to evaluate /oo dc where jo = sinx. Work with four 
decimal places. 


solution From the recursive trapezoidal rule in Eq. (6.9b) we get 
元 
Pi1=Tr) = 过 [Fo + Fr =0 
1 元 
Pi1=Tr/2) = 二 7Cr) 十 Jer/2 一 1.5708 


1 
al = Try/4) = 5r/ 十 了 [Fr/4 十 JFG3r7/g] = 1.8961 





1 
Ri = Jr/8) = 5T(r/ 罗 十 5 [Fer/8) + Flar/18) + 5r/8) + 7zr78)] 
一 1.9742 
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Using the extrapolation formulas in Eqs. (6.13), we can now construct the following 


table: 
局 1 0 
RPR 忆 > | 1.5708 2.0944 
Fl PR Fas3 ”| 1.8961 2.0046 1.9986 
Ri RM Rs 尺 4 1.9742 2.0003 2.0000 2.0000 


It appears that the procedure has converged. Therefore, / sinxcx = RM4=2.0000， 
which is, of course, the correct result. 


EXAMPLE 6.7 
Use Romberg integration to evaluate 度 和 2x2 cos 妇 cx and compare the results with 
Example 6.4. 


solution 
>> format ong 
>> [Integral ,numEval] = Tomberg(Qfex6_7,0,sqrt(pI)D) 
Integral = 
-0.89483146948416 
DumEval = 
257 
六 


Here the M-file defining the function to be integrated is 


function yy = [ex6_7(X) 
% Function used :in Example 6.7 
y = 2x(X 27)x*cos(X ` 2); 


Itis clearthat Romberg integration is considerably more effticient than the trape- 
Zoidal rule.Itrequired 257function evaluations as comparedto 4097 evaluations with 
the composite trapezoidal rule in Example 6.4. 


PROBLEM SET 6.1 





1， Use the recursive trapezoidal rule to evaluate 人 ln(l +tan2)dX. Explain the 
results. 


2. Thetable shows thepower Psuppliedto the driving wheels ofa car as afunction 
of the Speed zv. 下 the mass of the car is 10= 2000 kg, determine the time At 这 
takes for the car to accelerate from 1 my/s to 6 m/s. Use the trapezoidal rule for 
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integration. 瑟 z7 大 


6s 
Ar 一 711 (Z/P) dz 
5 
which can be derivedfromINewtonslawP = 17(dv/cdnandthe definition ofpower 


忆 王 必 区 





7(mn/s) |‖| 0 | 1.0 1.8 2.4 3.5 4.4 5 让 6.0 
P (kwW) 0 1 47 12.2 119.0 |31.8 | 40.1 | 43.8 | 43.2 









































3. Evaluate 人 cos(2 cos-1dx with Simpson's 1/3 rule using 2, 4 and 6 panels. 
Explain the resuljts. 


4，Determine j (1 十 Xg)-Lcx with the trapezoidal rule using five panels and com- 
pare the result with the“exact"” integral 0.243 75. 页 7 大 use the transformation 
3 
和 二/ 友 




















Thetable below givesthepull Fofthe bowasafunction ofthe drawx. Ithe bow 
is drawn 0.5 m, determine the speed ofthe 0.075-kg arrowwhen itleaves the bow. 
大 the kinetic energy of arrow equals the work done in drawing the bow; that 


js, 71702/2 一 1 三 dx. 





X (mm) | 0.00 | 0.05 | 0.10 | 0.15 | 0.20 | 0.25 
上 (N) 0 37 71 | 104 | 134 | 161 











X (Im) | 0.30 | 0.35 | 0.40 | 0.45 | 0.50 
上 (N) 185 | 207 | 225 | 239 | 250 



































6. Evaluate 广 (4 十 3x3 - 2) dx byRomberg integration. 
7，Estimate 放 Jo dx as accurately as possible, where j 太 oo is defined by the data 





泡 0 苑 /4 元 /2 37/4 区 
Jo ‖ 1.0000 | 0.3431 | 0.2500 | 0.3431 | 1.0000 
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8. 


10. 


| 


12， 


Evaluate 


with Romberg integration. 万 ;1 Use transformation of variable to eliminate the 
indeterminacy atx = 0. 


Showthatity = jooisapproximatedbyanatural cubic spline with evenlyspaced 
knots at yx, 刀 , ,Mo the quadrature formula becomes 


及 
一 了 (拉丁 2 防 十 < 及 十 十 20pr1 十 J 
刀 3 
一 贡 ( 抱 十 2 名 十 启 十 十 26-1 十 条 


where Pis the spacing of the knots and 大 = ]J. Note that the first part is the 
composite trapezoidal rule; the second part may be viewed as a "correction for 
curvature. 


国 Use a computer program to evaluate 





/4 ax 
上 VSinX 
with Romberg integration. 责 1t use the transformation sinxX = 纪 . 


国 The period of a simple pendulum of length Zisr=4VZL/g HAO where g is 
the gravitational acceleration, 9o Tepresents the angular amplitude and 


人 
1(00) 一 1 
" V1-sin2(go/2)sin26 
Compute P(15?), 17(30") andP(45"),andcomparethesevalues with P(0) = 立 /2 (the 
appIoximation used for small amplitudes). 














The figure shows an elastic half-space that carries uniform loading of intensity 9 
over a circular area of radius . The vertical displacement of the surface at point 
了 can be shown to be 


cos20 
(站 王 I0 厂 过 Q 


V/ (1/G)2 一 Sin2 加 本 
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where Wo is the displacement at 了 7 = 4. Use numerical integration to determine 
IW/Io at7 = 20. 


13， 国 


























弥 








The mass 1 is attached to a spring offreelength pand stiffness 上 .The coefcient 
of friction between the mass and the horizontal rod is /. The acceleration of the 
mass can be shown to be (youmay wish to prove this) 苞 = -oo where 


Jo0 = 于 5+ 习 (1- 7) 
= 全 V 刺 下 翅 


Ithe mass is released frfom restatx 王 Ditsspeedatx=0is given by 


人 A 
10 一 引 COdx 
0 


Compute mw by numerical integration Using the data 10 = 0.8 kg, 忆 = 0.4 mm 
内 = 0.3, 大 = 80NAmmandg= 9.81 my/s2. 


14. 国 Debyes formula forthe heat capacity Cv of a solid is Cv = 9NKkg(W, where 


1/U X4eX 
3 
g( 肝 三 尼 1 三 二 齐 这 犀 


The terms in this equation are 
N = number ofparticles in the solid 
天王 Boltzmann constant 
2 一 亚 光 OD 
了 = absolute temperature 


Onb = Debye temperature 


Compute g5(O fromxw= 0to 1.0inintervals of0.05 andplot the results. 


15. 国 Apower spike in an electric circuit resujlts in the cuUrrent 


iD = ie sin(21/ 略 ) 
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6.4 


acroSss a Iesistor. The energy E dissipated by the resistor is 
Co 
局 一 | 有 [TD]2 直 
0 


Find 忆 usingthe datazm = 100A, 尺 =0.592andz=0.01s. 


Gaussian Integration 
Gaussian Integration Formulas 


Wefoundthat Newton-Cotes formulas for approximating 太 Jadx work best 计 三 20) 
is asmooth function, Such as apolynomial. This is also true for Gaussian quadrature. 
However Gaussian formulas are also good at estimating integrals of the form 


六 
| WU(OO Fdx (6.15) 


where w(Co, called the weigpt7g jctio1, can contain singularities, as long as they 
are integrable.An example ofsuch an integral is 人 (+x2)Inxdadx.Sometimes infhinite 
limits, as im 帮 ” exsinxdx, can also be accommodated. 

Gaussian integration formulas have the same form as Newton-Cotes rules: 


T= 》 4ijFoo) (6.16) 
诡 1 


where, as before, 1 represents the approximation to the integral in Eq. (6.15). The 
difference lies in thewaythatthe weights 4 andnodal abscissas % are determined. In 
Newton-Cotes integration the nodes were evenly spaced in (C, 用 , ie their locations 
were predetermined. In Gaussian quadrature the nodes and weights are chosen So 
that Eq. (6.16) yields the exact integral 让 /oO is apolynomial of degree 27 一 1 orless; 
that is， 


万 7 
1 I(X P(OOdx 一 >》， 4PO0)，710<<21 一 1 (6.17) 
Q i=1 


One way of determining the weights and abscissas is to Substitute 妃 (0] = 1 忆 (0) = 
2 Pi 100 =X2rlin Eq.(6.17) and solve theresulting 27equations 


D 有 ， 
| LUCOOxzidx = 》 如，7=0,1 .271 一 1 
@G 


1 一 1 


for the unknowns 4 and 和 7 一 1,2,..., 7 
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As an jlustration, let ww =e =00=coand7=2.Thefour equations 
determining xz, zx, 4l and 42 are 





Co 
1 ed 一 4 十 4 
0 
Co 
人 exXadx 一 4 十 4 和 
0 
Co 
上 ezX20x5 一 4 十 42X2 
0 
Co 
上 exX3dx = 由 全 十 473 
0 
After evaluating the integrals, we get 


4+4=1 
4 十 4xp 一 1 
4 人 十 42x2 一 2 


4 全 十 4xz3 一 6 


The solution is 


V2+1 
=2-v2 4= 一 一 - 
2vV5 
V2-1 
一 2 十 V2 4 = 一 一 一 
” 2V5 
Sothatthe quadrature formula becomes 
oo 本 辣 1 
1 cadrw 本 广 [wz+D7(2- 了 +w-DF(2+v9] 


Due to the nonlinearity of the equations, this approach will not work well for 
large 7. Practical methods of finding 2 and 4i require some knowledge of orthogo- 
nal polynomials and their relationship to Gaussian quadrature. There are, howeve, 
Several “classical ”Gaussian integration formulas for which the abscissas and weights 
have been computed with great precision and tabulated. These formulas can used 
without knowing the theory behind them, since al one needs for Gaussian integra- 
tion are the values of yx and 人. 于 you do not intend to venture outside the classical 
formulas, you can Skip the next two topics. 
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“Orthogonal Polynomials 


Orthogonal polynomials are employed in many areas of mathematics and numerical 
analysis. Theyhave been studiedthoroughlyandmany oftheir properties are known. 
What follows is a very Small compendium of a large topic. 

The polynomials p,(x, 贱 = 0,1,2,... (is the degree ofthe polynomial are said 
to form an o7 态 ogo1C1 sef in the interval (4, 甩 with respect to the WeiS7 厄 8 12c 丰 Oo7 
ZW(X)] 这 


太 
1 WUw(Xpn(pn(OOd 一 0，7110 夭 帮 (6.18) 


The setis determined, exceptfora constantfacton bythe choice ofthe weightingfunc- 
tion andthe limits ofintegration. That is, each set of orthogonal polynomials is asso- 
ciated with certain w( xz, dand 忆 . The constant factor is Specified by standardization. 
Some of the classical orthogonal polynomials, named after well-known mathemati- 
cians, are listed in Table 6.1. The last column in the table shows the standardization 
































Used. 
Name Symbol | 4 忆 纪 (2) 人 纪 (2 [eco Cx 
Legendre 有 (0) 一 1 1 1 2/(27 十 了 1) 
Chebyshev 了 (2 一 1 TI | 人 三 诊 )=72 T/2 (> 0) 
Laguerre 也 1) 0 | oo Es=” 1 
Hermite 也 (20) 一 co | co -人 /元 27 聘 
Table 6.1 


Orthogonal polynomials obey recurirence relations of the form 
Gag1t100 = ( 太 十 co0Vn00 一 地 pi-10O0) (6.19) 


Ifthe first two polynomials ofthe set are known, the other members ofthe set can be 
computed from Eq. (6.19). The coefficients in the recurrence formula, together with 
po(0 and pl(0o, are given in Table 6.2. 























Name po(X) | 5100 C1 心 Cn 丰 
Legendre 1 下 用 十 工 0 21 十 1 | 刀 
Chebyshev 1 允 1 0 2 1 
Laguerre 1 1T 一 X | 7 二 1 1 27 二 1 一 1 用 
Hermite 1 冯 尖 1 0 2 上 














Table 6.2 
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The classical orthogonal polynomials are also obtainable from the formulas 


网 站 玫 [=-z"] 


27111 CN 





也 (z) = cos(ncos-12，7> 0 





ZLn(x) 一 2 (xz"e- (6.20) 
cx 


2 Cd 训 
丽 (] = (一 De Te ) 
闪 
and their derivatives can be calculated from 
(一 zz 有 态 00 = 厂 一 Xp00 十 Pi 10O9] 
(一 X2)TIO0 = 7 一 X 友 CO0 十 PT IOO] 
XZLA(OO 一 有 [Zn0O0 一 工 六 1(] (6.21) 
及 (CO0 = 21 万-1(00 


Other properties of orthogonal polynomials that have relevance to Gaussian in- 
tegration are: 


。 on has real distinct zeroes in the interval (CQ, 站 . 
。 The zeroes ofp,(X) lie between the zeroes of pl(x). 
。 Any polynomial 忆 (x) of degree 7 can be expressed in the form 


用 
已 00 = 》 cipi(g (6.22) 
记 0 
。 It follows from Eq. (6.22) and the orthogonality property in Eq. (6.18) that 


刀 
1 WOP(Opnmndx 一 0，710>0 (6.23) 


*Determination of Nodal Abscissas and Weights 


Theorem Thenodal abscissas 和 ,2,. ,xmarethezeros ofthe polynomial p,(z) that 
belongs to the orthogonal set defined in Eq. (6.18). 

Proof We start the proofby letting 太 zx) = 书 ，1(X) beapolynomial of degree 27 一 1. 
Since the Gaussian integration with 2nodes is exact for this polynomial we have 


忆 用 
| UP IC0Odx = 》 Pa100) (a) 


二 


Apolynomial of degree 27-- 1 can always written in the form 


已 -100 = QI10 十 及 1C0pn(O (b) 
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where Q100, RUI andp(x) are polynomials ofthe degree indicated by the 
Subscripts.1 Therefore， 


已 


到 忆 
1 岂 (z 忆 ， 100dGxX 一 1 (OOQ -100GX 十 1 岂 (OxRR -1O0pn0OOGX 


@ 


But according to Eq. (6.23) the second integral on the Tight hand-side vanishes， 
So that 


万 忆 
1 vpnaar= 上 (OO QI100GX (C) 


Because apolynomial of degree7- 1l is uniquely defined by7points, it is always 
possible to fnd 4 such that 


用 


忆 
人 more= 六 AQnon dd 


这 
In order to arrive at Eq. (aj, we must choose forthenodal abscissas % theroots of 
on) = 0.According to Eq. (b) we then have 


胞 访 区 ) = 人 (二 (e) 


which together with Eqs. (c) and (d) leads to 


及 


万 万 
Ps/ oo 症 AP 


Q 这 | 
This completes the proof 
Theorem 


六 
4 | 友 ( 赂 帮 (CO 三 工 2. .天 (6.24) 
他 


where 妇 00 are the Lagranges cardinal functions spanning the nodes at 
2 和 X,. .Xi These functions were defined in Eq. (3.2). 
Proof Applying Lagranges formula, Eq. (3.1al, to Q1(0 yields 


Qi00 = 》 QiCoDei00 


这 1 
which upon substitution in Eq. (d) gives us 


也 


万 有 
> ， 【kw | wouGodx = 》 4Qn0o) 
& 1 一 1 


1 一 1 
OF 


用 六 
>》， Qn-100) 巴 一 1 woaCodz 三 鸡 
i 一 1 @Q 


1 It can be shown that Q 1(00 and 届 100 are unique for given P，100 and r( 划 . 
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This equation can be satisfied for arbitrary Q)，1 only 这 
厂 
4 一 1 (NiXGX 一 0，7 王 12.. .7 
如 
which is equivalent to Eq. (6.24). 


It is not difficult to compute the zeros XI 一 1,2,... ,71 ofapolynomial p,(O 
belonging to an orthogonal set by one of the methods discussed in Chapter 4. Once 
the zeros are knowmn, the weights 4 = 1,2,...,7 coud be found from Eq. (6.24). 
However the following formulas (given without proof) are easier to compute 





2 
Gauss-Legendre 44 = 5 
Q 一 好 )[ 太 oo)] 
1 
Gauss-Laguerre 4 = -一 一 一 一 (6.25) 
拉 [Z5Co)] 
27+1711 
Gauss-Hermite 4 一 En 
[及 oo)] 


Abscissas and Weights for Gaussian Quadratures 


Welisthere some classical Gaussian integration formulas. The tables ofnodal abscis- 
Sas and weights，covering 7= 2 to 6, have been Iounded off to si decimal places. 
These tables should be adequate for hand computation，but in programming yoUu 
mayneedmore precision oralargernumber ofnodes.Imthat caseyoushould consult 
other references,2 or use a subroutine to compnute the abscissas and weights within 
the integration program.13 

The truncation error in Gaussian quadrature 


也 用 
已 二 (0 Foodx 一 丰 太 罗 ) 
@ 下 


has the form 巨 = 天 (mo whereda<c<pb(kthevalue ofcis unknowni only its 
bounds are given). The expression for 天 (7 depends on the particular quadrature 
being used. Ithe derivatives of /2 can be evaluated, the error formulas are useful 
is estimating the error bounds. 


12 Fordbpook ofMatpemzatical Factions M.Abramowitz and LA. Stegun, Dover Publications (1965); 
A.H. Stroud and D. Secresb Gazssia12 Quad1ature Formzuias Prentice-Hall (1966). 

13 Several such subroutines arelisted in NVz7mazerical Recipes 刀 Foroan 90 WH.Press etal.,Cambridge 
University Press (1996). 
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Gauss-Legenare quadrature 








下 用 
1 7 三 >》 十 7 (6.26) 
到 1 
士 多 示 十 熏 帮 

1 一 2 天 三 
0.577 350 1.000 000 | 0.000 000 0.568 889 

1 一 3 0.538 469 0.478 629 
0.000 000 0.888 889 | 0.906 180 0.236927 
0.774597 0.555 556 1 一 6 

九 一 4 0.238 619 0.467914 
0.339 981 0.652 145 | 0.661 209 0.360762 
0.861 136 0.347 855 | 0.932 470 0.171 324 














Table 6.3 


This is the mostoften used Gaussian integration formula. Thenodes are arranged 
Symmetricalyabout = 0,andthe weights associated with a symmetricpair ofnodes 
are equal. For example, for = 2wehave85l = -5 and4l = 42.Thetruncation errorT 
in Eq. (6.26) is 


227+1 (04 


(7p+DTI(C27 





ea，-1<c<1l (6.27) 


To apply Gauss-Legendre quadrature to the integral 六 Jo0dxz we mustfirstmap 
the integration range (, 站) into the "standard" range (一 |， 1j. We can accomplish this 
by the transformation 

_D+I 0 一 4 


大 一 
2 二 2 








(6.28) 


Now dx= 嘻 一 /2 andthe quadrature becomes 
也 站 一 4 用 
1 Jodaxs 一 2 4 Fo (6.29) 


where the abscissas imust be computed from Eq. (6.28). The truncation erTOT 
here is 


钱 一 四 ]27+1 (20 人 


三 人 Q<C< 旋 (6.30) 
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Gauss-Chebyshev quadrature 


1 用 
| (=- 问 ”7 二 2 J 00) (6.31) 
Ai 


Note that all the weights are equal: 4 = r/1. The abscissas of the nodes, which are 
Symmetric about X = 0, are given by 











(27 一 JJ) 
Xi 三 CO0S 一 一 一 一 (6.32) 
277 
The truncation error is 
二 jaO，-1<c<1 (6.33) 
Gauss-Laguerre quadrature 
Co 隐 
1 efo0dzs 》 oa) (6.34) 
这 1 
好 4 区 4 
7 一 2 九 一 5 
0.585786 0.853 554 | 0.263 560 0.521756 
3.414214 0.146447 | 1.413 403 0.398 667 
1 一 3 3.596 426 (一 1D)0.759 424 
0.415775 0.711093 | 7.085810 (一 2)0.361 175 
2.294280 0.278517 | 12.640 801 (一 和 0.233 670 
6.289 945 (一 D)0.103 892 7 一 6 
有 一 4 0.222 847 0.458964 
0.322 548 0.603 154 | 1.188 932 0.417 000 
1.745761 0.357418 | 2.992736 0.113 373 
4.536 620 (一 D)0.388791 | 5.775 144 (一 1D)0.103 992 
9.395 071 (一 3)0.539295 | 9.837467 (一 3)0.261 017 
15.982 874 (一 6)0.898 548 














Table 6.4. Multiply numbers by 104 where Kis given in parentheses 


(00 


1 一 Fem(c)，0<c<oo (6.35) 


Gauss-Hermite quaarature: 


1/ efoodaxs 》 4iFoo) (6.36) 
一 2 | 
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Thenodes are placed symmetrically aboutx = 0 each symmetricpairhaving the 








Same weight. 
主 拓 4 土 友 汪 
1 一 2 九 一 5 
0.707 107 0.886 227 | 0.000 000 0.945308 
太 =3 0.958 572 0.393 619 
0.000 000 1.181636 | 2.020 183 (一 1] 0.199 532 
1.224745 0.295 409 1 一 6 
九 一 4 0.436 077 0.724 629 
0.524 648 0.804914 | 1.335 849 0.157 067 
1.650 680 (一 1)0.813 128 2.350 605 (一 2)0.453 001 














Table 6.5. Multiply numbers by 105 where Kis given in parentheses 











二 次 呆 Fato，0<c< co (6.37) 
Gauss 9quadrature with /ogarrtpmic simguljarrty 
1 有 
1 foodxrs 一 >》 Jo) (6.38) 
i=1 
JJ 4 JJ 4; 
1 一 2 1 三 5 
0.112 009 0.718 539 | (-IJ0.291 345 0.297 893 
0.602277 0.281 461 0.173 977 0.349 776 
1.=3 0.411703 0.234488 
(一 ])0.638 907 0.513 405 0.677314 (一 1)0.989 305 
0.368 997 0.391 980 0.894771 (一 1)0.189 116 
0.766 880 (一 1)0.946 154 1 一 6 
1 一 4 (一 1)0.216 344 0.238 764 
(一 J)0.414485 0.383 464 0.129 583 0.308 287 
0.245 275 0.386 875 0.314020 0.245 317 
0.556 165 0.190 435 0.538 657 0.142 009 
0.848 982 (一 1)0.392 255 0.756916 (一 1)0.554.546 
0.922 669 (一 1)0.101 690 














Table 6.6. Multiply numbers by 105 where Kis given in parentheses 
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是 人 
CI 


Where K(C2) = 0.00285, K(3) = 0.000 17, K(4) = 0.000 01. 


Femlo，0<c<1l (6.39) 


国 5auSSsNodqes 





The function gaussNodes computes the nodal abscissas X and the corresponding 
weights 4i used in Gauss-Legendre quadrature.14 It can be shown that the approxi- 
mate values of the abscissas are 


并 (1 一 0.25) 
Xi 一 COS 
及 十 0.5 





Using these approximations as the starting values，we compute the nodal ab- 
Scissas by finding the nonnegative zeros of the Legendre polynomial j(x) with 
the Newton-Raphson method (the negative zeros are obtained from symmetry). 
Note that gaussNodes cajlls the subfunction legendre, which returns 及 (D and its 
derivative. 


function [X,A] = gaussNodes(n,tol) 

% Computes nodal abscjissas X and welights A of 
% Gauss-Legendre Dn-point quadrature . 

% USAGE: [xX,A] = gaussNodes(n,epsilon,maxIter) 


% tol = error tolerance (default :is 1.0e4x*eps) . 


If nargin < 2; tol = 1.0e4*eps;i end 
A = zeros(n,1); X = Zeros( 人 mn,1) ; 
DRoots = fixCn + 1)X/2; % Number of non-neg. roots 
for 工 = 1:nRoots 
tt = cos( 人 (pix*(I - 0.25)/GCn + 0.5)); % Approx. roots 
ftor Jj = 工 :30 


[Pp,dqp] = Legendre(t,n) ; % Newton 's 
qt = -pb/dp;t= 七 + dti; % Foot finding 
If abs(Cdt) < tol % method 
X(CI) = 七 ; XCn-I+1L) = -七 ; 
ACi) = 2/(C1-t 2)V/dp 2; % Edq. (6.25) 
ACn-i+1) = ACID) ; 
break 


14 This function is an adaptation of a routine in Nz7zazerical Recipes 态 Fortram 90, WH. Press et al,， 
Cambridge University Press (1996). 


228 | Numerical Integration 


end 
end 


end 


function [p,dqp] = Legendre( 人 t,Pn) 

% Evaluates Legendre polynomial Pb of degree 了 匡 
% and its _ derivative qp at X= 上 七 . 

p0O =1.0; p1L1 = 七 ; 

for K = 工 :mn-I 


DPD = ((C2*Kk + 1)*tr*p1L - kx*p0O)V/CGK + 1); % Edq.， (6.19) 
p0 = pl;p1 = Di 

end 

dD 三 下 *(CD0 三 七 *)7L 三 二 293 % Edqd. (6.21) 


国 5ausSssQuad 





The function gaussQuad evaluates 下 Jo dx with Gauss-Legendre quadrature US- 
ing n nodes. The function defining jx must be Supplied by the user. The nodal 
abscissas and the weights are obtained by calling gaussNodes. 


function 工 = gaussQuad(Cfunc,a,b,n) 
% Gauss-Legendre quadrature . 

% USAGE: 工 = gaussQuad(Cfunc,a,b,n) 
% INPUT : 


”% func = handle of function to be integrated ， 


% a,b = integration imits . 
% 了 = Order of integration . 
% OUTPUT : 


% 工 = integral 


CE 王 .三 乓 让 二: 二 ) 2 证 = 过 省 23 % Mapping constants 
[X,A] = gaussNodes(Cn) ; % Nodal apbscissas & weights 
Sum = 0 


for 工 = 1:1ength(Cx) 
Y = feval(Cfunc,clLl + c2x*X(I)); % Function at node 工 
Sum = Sum 二 ACI)xY; 

end 


工 = C2x*Sumi 


EXAMPLE 6.8 
Evaluate / (1 一 x2)3/2dx as accurately as possible with Gaussian integration . 
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solution As the integrand is smooth and free of singularities, we could use Gauss- 
Legendre quadrature. Howevemn the exact integral can obtained with the Gauss-- 
Chebyshev formula. We write 


| 让 人 二 X2) 
工 一 - 妇 “| = 了 
) 人 ) -1 V1 一 Xi 
The numerator j 太 20 = (1 一 X2)2 让 8 polynomial of degree four so that Gauss- 


Chebyshev quadrature is exact with three nodes. 
The abscissas of the nodes are obtained from Eq. (6.32). Substituting 娓 = 3，we 


get 
(27 一 JJ) 六 
Xi 一 COS 了 三 起 乞 3 
2(3) 

Therefore， 

2 一 COS 和 二 V3 

上 6 2 

克 

05 二 0 

和 Xo 一 COS 2 3 

六 6 ”2 





EXAMPLE 6.9 
Use Gaussian integration to evaluate > COSTXlnXCdxX. 


solution We split the integral into two parts: 


0.5 1 1 
上 coszxmxdx= 上 coszxzmxdz- 人 COSTTXInXCax 
0 


0 0.5 


The first integral on the right-hand side, which contains a logarithmic singularity at 
X=0, can be computed with the special Gaussian quadrature in Eq. (6.38). Choosing 
刀 一 4, wehave 


1 4 
cosTxXlnxctx 一 >》 4 COS 元 好 
0 i=1 
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wherew and 4i are given in Table 6.6. The sum is evaluated in the following table: 











壤 COS 元 好 4 4i coS 元 好 
0.041 448 0.991534 0.383 464 0.380218 
0.245 275 0.717525 “0.386875 0.277 592 
0.556165 一 0.175533 0.190 435 一 0.033 428 
0.848982 ”一 0.889 550 ”0.039 225 一 0.034 892 

地 一 0.589 490 











Thus 
昌 
| COSTXlnxdax、 一 0.589490 
0 


The second integral is free ofsingularities, so thatit can be evaluated with Gauss-- 
Legendre quadrature. Choosing again 7 = 4 we have 


1 4 
上 CoOSTXInXdx0.25 六 4 cos 元 好 ]n 和 
0 


滞 FE 
where thenodal abscissas are (See Eq. (6.28)) 


1+05 1 一 0.5 


= 一 本 生 一 0.75 十 0.25 和 5 





Looking up 5 and 4 in Table 6.3 leads to the following computations: 




















5 办 coOSTr3Xiln 和 4 Li cos 元 好 ]n 和 
一 0.861136 “0.534716 0.068 141 ”0.347 855 0.023 703 
一 0.339981 ”0.665 005 0.202 133 ”0.652 145 0.131 820 
0.339981 ”0.834995 0.156638 ”0.652 145 0.102 151 
0.861136 ”0.965 284 0.035 123 ”0.347 855 0.012218 
二 一 0.269 892 
位 om which 
1 
1 coSTXlnxdx 0.25(0.269 892) = 0.067473 
0.5 
Therefore， 


1 
| coSTXlnxdx 一 0.589490 -- 0.067473 = 一 0.656963 
0 


which is correct to six decimal places. 
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EXAMPLE 6.10 
Evaluate as accurately as possible 
”X 十 3 
0 VX 


solution Im its present form, the integral is not suited to any of the Gaussian quadra- 
tures listed in this article. But using the transformation 


顾 一 exX 





无 一 帮 ax 一 2fd 
We have 
古 一 2 / ( 己 +3)e-2dr = | (已 二 3)e-2dr 
0 一 Co 


Which can be evaluated exactly with Gauss-Hermite formula using only two nodes 
(7 一 2).Thus 


下 = (不 上 十 3) 十 4o( 太 十 3) 
= 0.886227 [(0.707107)2 + 3] + 0.886227[(-0.707107)2 + 3] 
= 6.203 59 


EXAMPLE 6.11 
Determine how many nodes are required to evaluate 


rr /si 2 
1 (2 四 
0 交 


with Gauss-Legendre quadrature to Six decimal places. The exact integral rounded 
to Six places, is 1.418 15. 


solution The integrand is a smooth function; hence it is suited for Gauss-Legendre 
integration.Thereisanindeterminacyatx = 0,butthisdoesnotbotherthequadrature 
Since the integrand is never evaluated at that point. We used the following program 
thatcomputesthequadrature with2, 3, ...nodesuntilthe desiredaccuracyis reached: 


% Example 6.11 (Gauss-Legendre quadrature) 
a=0;j) b= pi Iexact = 工 .41815; 
forn= 2:12 

工 = gaussQuad(CQafex6_11,a,b,n); 

If abs(I - Iexact) < 0.00001 
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The M-file ofthe function integrated is 


function YY = fex6_11(xX) 
% Function used :in Example 6.11 


Y = (SinCX)VX) 2; 


The program produced the following outpnut: 


工 .41815026780139 


5 


EXAMPLE 6.12 
Evaluate numerically 六 | 5 oo dx where j0 is represented by the unevenly spaced 
data 





蕊 卫 .2 了 2.0 2.4 2.9 3.3 
Jo ‖ -0.36236 | 0.12884 | 0.41615 | 0.73739 | 0.97096 | 0.98748 



































Knowingthatthe datapoints lie on the curve 丰 x) = 一 cosx evaluate the accuracy of 
the solution. 


solution We approximate xx) by the polynomial 户 (z) that intersects all the data 
points, andthenevaluate Jadx = 坟 | 5 记 00dxwith the Gauss-Legendreformula. 
Since the polynomial is of degree five, only three nodes (= 3) are required in the 
quadrature. 

From Eq. (6.28) and Table 6.3, we obtain for the abscissas ofthe nodes 


3 十 上 35， 3 三 5 











= 0.774597) = 1.6691 
贡 1 5 5 人 ) 6 
1. 
吉 己 一 交 大 
2 
3+15 3 一 15 
罗 一 三 十 一 一 (0.774597) = 2.8309 


We now compnute the values of the interpolant 户 (x) at the nodes. This can be done 
using the functions newtonPoly ornevillelisted in Art. 3.2. The results are 


记 (00) = 0.09808 记 (o) = 0.628 16 记 (0) = 0.952 16 
Using Gauss-Legendre quadrature 


1= 厂 maw= 瑟瑟 六 Am 
E 证 本 aa 2 加 iv 
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we get 


了 一 0.75 [0.555 556(0.098 08) 十 0.888 889(0.628 16) 十 0.555 556(0.952 16)] 
一 0.85637 


Comparison with 一 帮 cosXGxX = 0.85638 shows that the discrepancy is within the 
IOundofft error. 


PROBLEM SET 6.2 





下 


10. 


Evaluate 


的 ]nx 
一 一 一 -一 Cx 
X2 一 2X 十 2 


with Gauss-Legendre quadrature. Use (a] two nodes and (b) four nodes. 
Use Gauss-Laguerre quadrature to evaluate /(1 一 22)3e dx. 


Use Gauss-Chebyshev quadrature with si 这 nodes to evaluate 





区 /2 ax 
人 VSinX 
Compare the result with the“exact” value 2.62206. 7 Substitute sin x = 帮 . 


The integral jj sin xdx is evaluated with Gauss-Legendre quadrature using four 
nodes.Whataretheboundsonthetruncation erroriresultingfromthequadrature? 


How many nodes are Iequired in Gauss-Laguerre quadrature to evaluate 


1 esSinXdxtosix decimal places? 


Evaluate as accurately as possible 
1 2x+1 
一 一 0x 
0 VX(1 一 
矶 1 大 SubstituteX 一 (] 十 力 /2. 
Compute / sinxlnxcaxto four decimal places. 


Calculate the bounds on the truncation error 这 / xsinxcx is evaluated with 
Gauss-Legendre quadrature using three nodes. What is the actual error? 


Evaluate 万 (sinh x/Z) dx to four decimal places. 


上 XCX 
0 ex 十 1 


to six decimal places. 如 ?1 大 Substitute e“ = 1/ 


Evaluate the integral 
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由 


12. 


13. 


14. 


国 The equation ofan ellipseis x2/i2 + ]J2/12 = 1.Writeaprogramthat computes 
the length 


公 
S=21 VI+(d/dn2dx 
一 @ 
of the circumference to four decimal places for given 0 and D. Test the program 


with =2andzp=1. 


国 The error function, which is ofimnportance in statistics, is defined as 


erf(x) 一 2 人 ed 
球员 


Write a piogram that Uses Gauss-Legendre quadrature to evaluate erf(x) for a 
given x to six decimal places. Note that erf(x) = 1.000 000 (correct to 6 decimal 
places) when x > 5. Test the program by verifying that erf(1.0) = 0.842 701. 








上 2 





























The sliding weight of mass 7 is attached to a Spring of stiffness K that has an 
undeformed length 工 . When the mass is released from rest at B, the time it takes 
to reach 4 can be shown to be 上 = CV11z/ 扩 where 


EE 上 [CE- 1 =- (YLI+ 逐 - 中 dz 


Compute C to si decimal places. 三 the integrand has a singularity at z 王 1 
thatbehaves as (1 -- 2])-12. 
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A uniform beam forms the semiparabolic cantilever arch 4B. The vertical dis- 
placement of 4dueto the force P can be shown to be 


PD3 用 
5 一 二 


where ETis the bending rigidity ofthe beam and 


:的 -人 大国 


Write aprogram that computes C(P/D forany given value of p/pto four decimal 
places. Use the program to compute C(0.5), C(1.0) and C (2.0). 


人 ln(sin xz) dx.A“bruteforce" method 


that works is to Split the integral into Several parts: ffom x = 0to 0.01 from 0.01 
to 0.2 and from x= 0.2 to r/2. In the first part we can Use the approximation 
sinx 交 X Which allows us to obtain the integral analytically The other two parts 
can be evaluated with Gauss-Legendre quadrature. Use this method to evaluate 
Tto Si decimal places. 


15， 国 Thereisnoelegantwayto compute7 一 





16， 力 
户 (m) 
112|-_ 620 
80L_ 612 | 
co 575 
35| 530 
15 3 
0 -一 D(Pa) 





The pressure ofwind was measured atvarious heights on avertical wall as Shown 
on the diagram. Find the height of the pressure center which is defined as 
和 及 PP 夯 
中 cr 


1 fit a cubic polynomial to the data and then apply Gauss-Legendre 
quadrature. 


“6.5 Multiple Integrals 
Multiple integrals, such as the area integral / /jx, J) dx can also be evaluated 


byquadrature. The computations are Straightforward 计 theregion ofintegration has a 
Simple geometric shape, such as atriangle oraquadrilateral. Due to complications in 
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specifying the limits ofintegration on xyand j, quadrature is not apractical means of 
evaluating integrals over irregular regions. However an irregular region 4 can always 
be approximated as an assembly oftriangular or quadrilateral subregions 41, 42,...， 
calledjijpziteelemets,asilustratedin Fig.6.6.Theintegralover 4canthenbeevaluated 
by summing the integrals over the finite elements: 


1 renaws 开 / Fe JGdxcty 
4 全 


Volume integrals can computed in a similar manner Using tetrahedra or Tectangular 
prisms for the finite elements. 


Boundary of region A 


FEigure 6.6. Finiteelementmodelofan irregular 
ITegion. 




















FEigure6.7. Mappingadqduadrilateralinto the standardrectangle. 


Consider the double integral 


1 1 
| | JE, 1] 导 c1 
二 和 以 于 


over the rectangular element shown in Fig. 6.7(a]. Evaluating each integral in 
turn by Gauss-Legendre quadrature using 7 nodes in each coordinate directiom， 
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we obtain 
六 守 A7enm= 袜 | 半 Areem| 
OF 
we 古人 0 (6.40) 


了 1 1 


The number of integration points 7 in each coordinate direction is called the 怒 - 
ie817atio17 order. Figure 6.7(a] shows the locations of the integration points used in 
third-order integration (7 = 3). Because the integration limits were the“standard” 
limits (--1, 1) of Gauss-Legendre quadrature, the weights and the coordinates of the 
integration points are as listed Table 6.3. 

In order to apply quadrature to the quadrilateral element in Fig. 6.7(b), we must 
first map the quadrilateral into the “standard" rectangle in Fig. 6.7(a). By mapping 
we mean a coordinate transformation X 一 X(E, 7 =]Jy(E,7) that results in one-to- 
one Correspondence between points in the quadrilateral and in the rectangle. The 
transformation that does the job is 


X(, 0) 一 2Ne 7 力 区 JJ 个 ,四 一 we， 人 妃 基 (6.41) 
=1 =1 
where (Xe, Jp) are the coordinates of corner Eofthe quadrilateral and 
MiG, 1 二 2 一 让) 亿 一作 
有 车 帮 = 了 (十 眉 (一 吕 (6.4) 
人 必 直 ,四 三 2 十 ( 十 妃 


1 
Na, 1) 一 阅 一 引 (L 十 7 


The functions NeG,7)，known as the Spape jzctio1ps are bilinear (linear in each 
coordinate).Consequently straightlinesremain straightuponmapping.Inparticular， 
note that the sides ofthe quadrilateral are mapped into theliness = 十 land7 = 士 1. 

Because mapping distorts areas, an infinitesimal area element d4 = dxzcdy ofthe 
quadrilateral is not equal to its counterpart d dj] of the rectangle. It can be Shown 
that the relationship between the areas is 


dry=17G, 丰 | 大 do (6.43) 
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where 
7 
| 人 且 铺 
了 (1) 一 ax 8y (6.44al) 
07 07 


is known as the /copiam 171011rix of the mapping. Substituting from Eqs. (6.41) 
and (6.42) and differentiating, we find that the components of the Jacobian matri 这 











are 
记 1 三 2 [一 dL 一 肋 轴 十 (一 妨 多 十 (十 力 始 一 (十 力 芭 ] 
刀 2 三 [一 人 一 力 用 十 由 一 妨 罗 十 由 十 力 为 一 寺 十 力 功 ] (6.44b) 
721 = 2 [一 (一 避税 一 (十 引 罗 十 (十 引 区 十 (一 习 芭 ] 
722 = 2 [一 (一 司 坟 一 (十 避 六 十 (十 避 为 十 (一 习 J] 


We can now wiite 


1 
1 renaw= 1/ 1 BE JE 人 直面 (6.45) 
4 一 1 v 一 1 


Since the right-hand side integral is taken over the“standard"” rectangle, it can be 
evaluatedusingEq. (6.40). Replacing 丰 , 7) inEq. (6.40) bytheintegrandin Eq. (6.45)， 
we get the following formula for Gauss-Legendre quadrature over a quadrilateral 
Iegion: 


死 用 


7 二 44i [LED JE 7TGED 7| (6.46) 


Thesand7coordinates oftheintegrationpointsandtheweights canagainbeobtained 
位 om Table 6.3. 


国 5auSssQuad2 





The function gaussQuad2 computes 厂 / jxz,J)dxcay over adquadrilateral element 
with Gauss-Legendre quadrature of integration order n. The quadrilateral is de- 
fned by the arrays x and y，which contain the coordinates of the four corners 
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ordered in a coV1terclockwise diectiom around the element. The determinant of 
the Jacobian matrix is obtained by calling detJ; mapping is performed by map. 
The weights and the values of gs and 7 at the integration points are computed by 
gaussNodes jisted in the previous article note that 5 and 7 appear as s and t ip 
listing). 


function 工 = gaussQuad2(func ,X,Yy,Dn) 

% Gauss-Legendre quadrature over a quadrilateral . 
% USAGE: 工 = gaussQuad2(func,X,Yy,Dn) 

% INPUT : 


% func = handle of function to be :integrated . 


9%6 习 = [x1;X2;X3;X4] = X-Ccoordinates of corners . 
% Y = [yl;Yy2;Y3;Y4] = Y-coordinates of corners ， 
% 了 = Ordez of ntegratIon 

% OUTPUT : 

% 工 = Integral 


[t,A] = gaussNodes(Cn); 工 = 0; 
for 工 = 工 :nm 
生 右 下 二 二 下 下 
[xNode,yNode] = map(x,y,t(CI),t(C 林 )); 
Z = feval(Cfunc,xNode,yNode) ; 
detJ = Jac(CxX,Yy,t(CI) ,t(CJD) Di 
工 = 工 +ACG)*AGCJJx*xdetJ*zZi 
emnd 


end 


function detJ = Jac(xXx,y,s,t) 
% Computes determinant of Jacobian matzIX . 


可 = Zeros(2) ; 


J(1,1) =- (1 - t)*x(1) + (1 - t)*X(C2)... 
+ (1 + 上 t)*X(3) - (1 + 七 )*XC4) ; 
2 腔 二 (人 关 击 (0 
二 CL 半 二 汪汪 《了 二) 二 CC47)3 
J(2,1) =- (1 - S)x*x(1I) - (1 + S)x*X(2)..， 
+ (1 + S)*x(3) + (1 - S)*x(C4) ; 
本 《25297 且 全 (人 十 8) 329 


二 《1 二 三 )3 区 43 二 《 工 = 8DJYYC455 
Qet 可 三 (了 (开工 )*J(C2 23 = 本 ( 王 ,20+JC2， 1777XL6; 
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function [xxNode,yYNode] = map(X,y,s, 七 ) 

% Computes X and Yy-coordinates of nodes . 
N = Zeros(4,1) ; 

NG 三 (了 二 (二 )74; 

NC2) = (1 + S)*(1 - 七 )/4; 

N(C3) ( 工 + S)*x(1L + 七 )X4; 

N(C4) (1 - S)x(1LI + 七 )/X4; 

XNode = qot(CN,X); YNode = dotCN,Y); 


EXAMPLE 6.13 





@ 
四 
3 
他 
2 0@” 


Evaluate the integral 
1= 人 e+J)axd 
over the quadrilateral shown. 
solution The corner coordinates ofthe quadrilateral are 
人 人际 汉 2 0| yY=|o 。 3 2| 


The mapping is 


4 
X(G, 1) = 》 NT 个 , 帮 区 








/一 1 
二 
4 4 
一 1 十 
4 
JJ 人, 力 一 》 NG 四 了 
/一 1 
二 二 人 


人 6 十 引 ( 十 本 
本 4 
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which yieldqs for the Jacobian matri 





4 
05 6851 4 
隔 , 1 一 ax 3 一 5 十 上 
071 07 4 
Thus the area scale factor is 
5 十 去 
17 舍 , 四 | 三 了 


Now we can map the integral from the quadrilateral to the standard rectangle. Refer- 
Iing to Eq. (6.45), we obtain 


1 1 
is | [+ 池 + 本 | 相册 
3LVysi 





4 人 4 


“55 1 -292 下 25 海 1 
= dd 
1 人 中 we 


Notingthatonlyeven powers of5 and7 contribute to the integral we can simplify the 


integral to 
41 
工 二 (个 Gd = 一 
人 情人) aa 





EXAMPLE 6.14 
Evaluate the integral 


三 上 cos 艺 cos 一 Cx cd 


by Gauss-Legendre quadrature of order three. 


Solution From the quadrature formula in Eq. (6.40), we have 


3 3 
二 >》， 444i cos Z 二 cos 


这 由 EI 











The integration points are shown in thefigure; their coordinates and the correspond- 
ing weights are listed in Table 6.3. Note that the integrand, the integration points and 
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the weights are all symmetric about the coordinate axes. It follows that the points 
labeled a contribute equal amounts to 7 the same is true for the points labeled 忆 . 
Therefore， 


> 工 (0.774 597) 


了 = 4(0.555556)2 cos 5 





0.774597 0 
十 4(0.555 556)(0.888 889) cos 玫 COS 到 


2 又 
十 (0.888 889)” cos” 2 
一 1.623 391 
The exactvalue ofthe integral is 16/r2 s% 1.621 139. 
EXAMPLE 6.15 
曙 
XX 











Utilize gaussQuad2 to evaluate 了 = /jx, Jadxzady over the quadrilateral shown， 
where 


jc 用 = 一 2 一 2 
Use enough integration points for an “exact” answeL. 


solution The required integration order is determined bythe integrand in Eq. (6.45): 


下 
| 1/ 三 区 GE 四, JE 四 ] 7 7 四 1G5 GT (al 
= 


Wenotethat176, 7 definedin Eqs. (6.44),is biquadratic. Since the speciftied Frx, 
is also biquadratic, the integrand in Eq. (aj is a polynomial of degree4in both 5 and 
1. Thus third-order integration (7 = 3) is sufficient for an “exact” result. Here is the 
MATILAB command that performs the integration: 


>> 工 = gaussQuad2(Gefex6_15,[0;4;4;1],[0;1;4;3],3) 


于 237Z78 
>>> 
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The M-file that returns the function to be integrated is 


function Z = fex6_15(X,Y) 
% Function used :in Example 6.15. 
民 三 (CCGR = 20)2#CY = 27 2; 


Quadrature over a Triangular Element 


OA@ 


Eigure 6.8. Quadrilateral with two coincident corners. 


O 


Atriangle may be viewed as a degenerate quadrilateral with two of its corners 
occupying the same location, as ilustrated in Fig. 6.8. Therefore, the integration for- 
mulas overaquadrilateral region can also beusedfor atriangular element. Howeve, 
it is computationally advantageous to Use integration formulas specially developed 
for triangles, which we present without derivation.15 


FEigure 6.9. Triangular element. 





Consider the triangular element in Fig. 6.9. Drawing straight lines from the point 
Pinthetriangle to each ofthe corners divides the triangle into three parts with areas 
4 4 and 43.The so-called aea coo1diPadtes of P are defined as 


4 
oi 一 亏 ， 1 一 1, 2, 3 (6.47) 
where 4is the area of the element. Since 4 + 4 二 43 = 4 the area coordinates are 
Ielated by 
cl 十 2 十 3 一 1 (6.48) 


Note thatwi Tanges from 0 (when Plies on the side opposite to cornerD to 1 (when 己 
is at COIner 站 


15 The triangle formulas are extensively used in the finite method analysis. See, for example, O.C. 
Zienkiewicz andR.L Taylonr 7T7jpe Fizte Blemze1t Metpod, Vol. 1 4th ed., McGraw-Hill (1989). 
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Aconvenient formula of computing 4from the corner coordinates (2, J) is 


1 1 1 1 
44 一 Xl 和 刀 妈 (6.49) 
匀 久 多 


The area coordinates are mapped into the Cartesian coordinates by 


3 3 
X(al, 02, 0Q3) 一 >》 ai ]J(Ql, 2, 3) 三 >》 ai (6.50) 


1 一 1 1 一 1 


The integration formula over the element is 
几 / 三 Ix(a), ya)] d4 = 4》， WE 广 Ex(aa, Ja] (6.51) 
盘 大 


where awk represents the area coordinates of the integration point 有 and WA are the 
weights. The locations ofthe integration points are shown in Fig. 6.10, and the corre- 
Sponding values of ak and Wx are listed in Table 6.7. The quadrature in Eq. (6.51) is 
exact 计 /zx, JJ) is apolynomial ofthe degree indicated. 


个 不 个 


Eigure6.10. Integrationpoints oftrian- 
gular elements. 






































(a) Linear (b) 二 (c) Cubic 

Degree of 帮 x, 人 | Point CQK TV 大 

(al] Linear QZ 灿 35 /3 3 1 

(b) Quadratic CQ 1/2,0，17/2 17/3 
已 1/2,， 1/2, 0 1/3 
站 0 /2,，1/2 1/3 

(c) Cubic CQ 1/3, 1/3, 1/3 | 一 27/48 
忆 1/5,，1/5, 3/5 25/48 
G 3/5.1/5,1/5 25/48 
QZ 17V55375 75 25/48 

Table 6.7 


国 IangleQuad 





The function triangleQuad computes/ 厂 /jx dxcady overatriangular region us- 
ing the cubic formula 一 case (c) in Fig. 6.10. The triangle is defined by its corner co- 
ordinate arrays x and y, where the coordinates must be listed in a counterclockwise 
direction around the triangle. 
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function 工 = triangleQuad(Cfunc ,X,Y) 
% Cubic quadrature over a triangle . 
% USAGE: 工 = triangleQuad(Cfunc ,X,Y) 
% INPUT : 


% func = handle of function to be integrated . 


9%6 买 = [xl1;Xx2;X3] X-coordinates of corners . 
9% Y = [yl1;y2;Yy3] Yy-coordinates of corners . 
% OUTPUT : 

% 工 = Integral 


alpha = [1/3 1/3 1/3; 1/5 1/5 3/5;..， 
35 十] 和 75 5 .375 于 /5]; 
W = [-27/48; 25/48; 25/48; 25/48]; 
XNode = alphax*Xxi YNode = alphax*yi 
A = (x(C2)*y(3) = 和 (3)*Y(G2) 
二 区 (17JAVYC37 汪 荆 C378YCELD7Eaa 
十 XUL)*Y(C2) = C2)*Y(CL7)2723 
Sum = 0; 
for 工 = 工 :4 
Z = feval(Cfunc,xNode(I) ,YNode( 人 ID) ) ; 


Sum = Sum 二 W(CI)*zZ; 


EXAMPLE 6.16 





@ 


Evaluate 了 一 小 了 Alx Jadxzdyovertheequilateral triangle shown， Wherel16 


3 _ 3X]P) 





_ 工 2 2 1 
jw 有力 = 了 CC 十 J 斑 ) 6C 


Use the quadrature formulas for (1) a quadrilateral and (2) atriangle. 


16 This function is identical to the Prandtl stress function for torsion of a bar with the cross section 
Showni; the integral is related to the torsional stiffness ofthe bar. See, for example, S.P Timoshenko 
andJ.N. Goodier 7TPpeory of Elasticiti, 3rd ed., McGraw-Hil (1970). 


246 | Numerical Integration 


solution of Part (1) Let the triangle be formed by collapsing corners 3 and 4 of a 
duadrilateral. The corner coordinates ofthis quadrilateral arex = [一 1, 一 1, 2, 2] Tand 
yY 王 [V3, -~ V3, 0, 017. To determine the minimum Iequired integration order for an 
exact Tesulb we must examine 三 [xxG, 四, y(G, 7 四] 17(4, 7 四 the integrand in Eq. (6.45). 
Since|7(5, 四 isbiquadratic and jx, J) is cubicin xz the integrandisapolynomial of 
degree 5 in X. Therefore, third-order integration will sufhice. The command used for 
the computations is Similar to the one in Example 6.15: 


>> 工 = gaussQuad2(QG@fex6_16,[-1;-1;2;2],..， 
[sqrt(37;-Sqrt(3);0;0],3) 
生生 
-1 工 .95288 


The function that returnsZ = 帮 x, J) is 


function Z = fex6_16(Xx,yY) 
% Function used :in Example 6.16 
Z= (X` 2 +Yy2)/2 - (X 3 - 3x*Xxy 2)/6 - 27/3; 


solution of Part (2) The following command executes quadrature overthe triangular 
element: 


>> 工 = triangleQuad(Cafex6_16,[-1; -1; 2],[sqrt(3);-sqrt(3); 0]) 
工 = 
-1 .5588 


Since the integrand is a cubic, this result is also exact. 

Note that only four function evaluations were required when using the tri- 
angle formulas. In contrast the function had to be evaluated at nine points ip 
Part (]). 


EXAMPLE 6.17 
The corner coordinates of a triangle are (0,0)，(16, 10) and (12,20). Compute 
了 六 ( 既 一 地) dxdyoverthis triangle. 
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Solution 











Because 丰 (x, J) is quadratic, quadrature over the three integration points shown 
in Fig. 6.10(b) will be suffhicient for an “exact" result. Note that the integration points 
lie in the middle ofeach side; their coordinates are (6, 10), (8, 5) and (14, 15). The area 
ofthe triangle is obtained from Eq. (6.49): 


1 1 1 1 1 ， 卫 并 
及 三 了 Xl 和 X 妈 | 一 7 0 16 12| = 100 
员 久 为 0 10 20 


From Eq. (6.51) we get 
C 
T= 4》 Wkjoxs J 
/一 4 


= 100 [57 10) 十 3 1， 5) 十 3 704， 问 


100 
= 了 本 [6-100+( 人 一 5+04 一 150]= 1800 





PROBLEM SET 6.3 





1.， Use Gauss-Legendre quadrature to compute 


了 肌 
1 | -xx =- 坟 dxdy 
= 过 1 


2. Evaluate the following integral with Gauss-Legendre quadrature: 


2 /3 
1/ 1 X2yJ2 cxcdty 
J)-0 -0 


3. Compute the approximate value of 


让 二 
全 5 
内 要 


with Gauss-Legendre quadrature. Use integration order (aj two and (bj three. 
(The true value ofthe integral is 2.230 985.) 
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4. Usethird-order Gauss-Legendre quadrature to obtain an appIoximate value of 


下: 淹 加 
| 1/ COS 工 尼 一 咏 Cx dy 
可 本 古 | 2 


(The exact value of the integral is 1.621 139.) 


5 
4 
7 
X 
2 
Map the integral / 六 xydxcy from the quadrilateral region shown to the “stan- 
dard" rectangle and then evaluate it analytically. 


6. 
4 
| 
| 
| 
下 
| 
X 
2 3 


Compute/ xdxdy overthequadrilateralregion shown byfirstmappingitinto 
the "standard'" rectangle and then integrating analytically. 


4 
X 
忆 


Use quadrature to compute 厂 /xz2 dx dy overthe triangle shown. 


8. Evaluate 厂 /xdxedy overthetriangle shown in Prob. 7. 


六 
X 
3 


Evaluate/ /3 -2 妨 ydxcdy over the region shown. 
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10. 
工 


由 2。 


13. 


14. 


5， 


16. 


Evaluate | 几 邓 ydxdy over thetriangle shown in Prob. 9. 
力 


Evaluate | 六 xy(C 一 X2)( 2 一 xy) dxdy overthe region shown. 


国 Compute /六 xzyexp(-X2) dx dy over theregion shown in Prob. 11 to four dec- 
imal places，. 


Evaluate | 六 和 -2 为 -2ydxcady overthetriangle shown. 


国 Estimate / /sinrxaxcady over the region shown in Prob. 13. Use the cubic 
integration formula for a triangle. (The exact integral is 1/z.) 

国 Compute / /sinrxsinr(y 一 2 轨 dxcdy to six decimal places where 4is the 
triangular ITegion Shown in Prob. 13. Consider the triangle as a degenerate 
quadrilateral. 





Write a program to evaluate / /Fo Jadxdy over an irregular region that has 
been divided into several triangular elements. Use the program to compute 
/xy 一 20dxzady overthe region shown. 
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IIATLAB Functions 


I = quad(Cfunc,a,b,tol) uses adaptive Simpsons rule for evaluating 工 = 
记 Jo dxzwith an errortolerancetol (defaultis 1.0e-6). To speedup executiom， 
vectorize the computation of func by using array Operators .% ./ and in the 
definition of func. For example, if Fo = 了 妈 sinx 十 1/z specifythe function as 


function Y = func(x) 
YY = (X. “3).*sin(X) 十 工 ./X 


工 = dqbldquad(Cfunc,XxMin,XMax,yYMin,yMax,tol) Uses quad to integrate OVeT a 
rectangle: 
VyMax APXMaxX 
了 -|/ 1 xc Jadxcdy 
yMin  JxMin 
I = quadl(func,a,b,tol) employs adaptive Lobatto quadrature (this method is 


not discussed in this boolo. It is recommended 让 veryhigh accuracy is desired 
and the integrand is smooth. 


There are no functions for Gaussian quadrature. 


7 


7 .1 





Initial Value Problems 


Solvey' = 了 ,内 ,y(O = a 


Introduction 


The general form of a first-order differential equation is 
了 三 人 (有 下 9 


wherey = dy/dxand jx, Jisagivenfunction.Thesolution ofthisequation contains 
anarbitraryconstant (the constantofintegration).Iofndthis constant wemustknow 
apoint on the solution curve; that is, y must be Specified at some value of x, Say at 
X 一 0.We write this auxiliary condition as 


J(a) = w (7.1b) 
An ordinary differential equation of order 7 
J 四 = cy ,JrD) (7.2) 
can always be transformed into first-order equations. Using the notation 
帮 =) =/ = (7.3) 


the equivalent first-order equations are 


1 站 1 


其 = 了 放 和 = 多 攻 = 基 ， 芒 三 Je] 芒 DJ 和 (7.4a) 


The solution now requires the knowledge 7 auxiliary conditions. 坟 these conditions 
are specified atthe same value ofx, the problem is said to be an 态 碟 CU VCIUe Propie170. 
Then the auxiliary conditions, called 怒 友 Ci co12ditio11s have the form 


JI = al J2(I] =a2 Js(O=a3 .JJ =an (7.4b) 


苞 到 Initial Value Problems 


7.2 


下 入 are specified at different values of xz the problem is called a pov7zda7y Cixe 
PTOD1e777. 
FEor example， 


J "=-)y》 JJO=1 YY(O=0 


is an initial value problem since both auxiliary conditions imnposed on the solution 
are given atXY 王 0.Onthe otherhand， 


]J “= 一) (三 Jy(r) =0 


is a boundary value problem because the two conditions are specified at different 
values of x. 

Inthis chapter we consider onlyinitial value problems. The more difhicultbound- 
aryvalue problems are discussed in the next chapter. We also make extensive Use of 
vector notation, which allows us manipulate sets of first-order equations in a concise 
form. For example, Eqs. (7.4) are written as 


yY =EFX JI ya =a (7.5al) 
where 
]2 
JJ 
EC)=|: (7.5b) 
JJ 
J xc, 凡 


Anumerical solution of differential equations is essentially atable of x- and y-values 
jlisted at discrete intervals of x. 


Taylor Series Method 


The Taylor series method is conceptually simple and capable of high accuracy Its 
basis is the truncated Taylor series fory about X: 


1 1 1 
yC 十 月 宇 yOO 十 Y (OOP 十 万 7 CO 大 十 林 Y "CO0 太 十 …: 十 人 CO7j1m (7.6) 


Because Eq. (7.6) predicts y at X 十 灵 from the information available at x, it is also a 
formula for numerical integration. The last term kept in the series determines the 
o1der ofimteg1atio1. For the Series in Eq. (7.6) the integration order is 770. 
The truncation error due to the terms omitted from the series, is 
工 
(1 十 1)! 





VOD 全) 万 741， X < < 大 十 五 
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Using the finite difference appIoximation 


yo (XK 十 站 一 V0m (2 





(1 十 ]) 入 
y (5) 万 
we obtain the more usable form 
入 (7 _ V(UM 
和 [yx 上 + 月 一 Yo0] (7.7) 


which couldbe incorporatedin thealgorithm to monitorthe errorin each integration 
Step. 


国 七 ay OT 
Thefunctiontaylorimplementsthe Taylorseriesmethodofintegration oforderfour. 
Itcanhandle anynumber offirst-order differential equations J = 万 (x, 攻 , 四)， 
1 = 1, 2,...,1.Theuserisrequiredto supplythefunction aerivthatreturnsthe4x 了 7 
alTay 

(Gy 天 用 和 功 

G 和 | 天才 所 

(y/) 交 本 玉 ， 区 本 和 

玫 
(yG)7 J9 玫 ” 本 


The function returns the arrays xSol and ySol that contain the values ofx andy 
at intervals 妨 . 


function [XSol,ySolL] = taylor(Cderiv,X,Yy,XStop ,Ph) 
% 4th-order ITaylor serlies method of integration ， 
% USAGE: [xSol,ySolLl] = taylLlor(Cderliv,X,Y,XStop ,hy) 


% INPUT : 

% deriv = handle of function that zeturns the matITIX 
% d= [dy/dx d` 2y/dx 2 d`3y/dx 3 d 4Yy/dx 4] . 
% 和 ,Y = :Initial values; yy must be a Tow Vector . 


% XStop = tetrminal Value of 玉 


% Ph = Increment of X used :in Integration (hn > 0) . 
% OUTPUT : 

% XSol = X-Vvalues at which solution is computed . 

% YSol = values of Yy corresponding to the X-VvValues ， 


If Size(y,1) > 1;)yY=Yy' ji end %ymustbe Fow Vector 
XSol = zeros(2,1); YySol = zeros(2 ,LengthCy) ) ; 
或 SOL( 工 ) 三 交 YYSOL〔C1 3 三 学 


臣 玖 Initial Value Problems 


用 三 > 汪汪 
while X < XStop 
Ph = min(h,xStop - X) 
d = feval(Cderiv,X,y); % Derivatives of [y] 
证 瑟 三 : 于 
for j = 1:4 ”% Build Taylor series 
hh = hhx*h/ 林 ; % hh = h > J/Jl! 
Y=Yyr+d(J,:)*hhi 
end 


又 =X+Thik=Kk+ 工 ; 
XSol(K) = Xi YSol(k,:) = Y; % Store current soln. 


end 


国 DTZIntSol 


This function prints the results xSol and ySol in tabular form. The amount of data 
is controlled by the printout frequency freq. For example, 让 freq = 5,， every fifth 
integration step wouldbe displayed.I 坟 freq = 0,onlythe initial and fnal values will 
be shown. 


function PTintSolL(xSol ,ySol ,fred) 

% Prints XSol andqd YSoln arrays :in tabular format ， 
% USAGE : PiFintSolL(xSol ,ySol ,fred) 

% freq = Printout frequency (Prints every fred-th 
% 1ine of xSol and YSol) . 


[m,n] = Size(CYySol) ; 


If freq == 0;freq = mi end 
head = 京子 
fozr 工 = 工 :nm 
head = Strcat(head ,” Y"” ,num2str(I) ) ; 
end 
fprintfChead); fprintfC' An D) 
for 工 = 1:fred:m 


fprintf('%14.4e",XSolL(I) ,ySolL(I，:));i fprintf(' nn ) 
end 
If 工 “= mi fprintf('%14.4e”,XSolLl(m) ,ySolLl(Gm,:)); end 


EXAMPLE 7.1 
Given that 


J+4y=x yyO=1 
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determine]y(0.2) withthefourth-order Taylor series methodusingasingle integration 
step.Also compnute the estimated error from Eq. (7.7) and compare it with the actual 
error. The analytical solution of the differential equation is 

1 1 


31e-ax 平 : 三 关 大 十 
32 4 8 32 





】 一 
Solution The Taylor series up to and including the term with 14 is 
1 1 1 
J( 和 = ]J(0) 十 ] (0O) 严 十 万 7 (O) 庆 向 本 (OO) 太 站 人 (0)7 (9 


Differentiation ofthe differential equation yields 


三 一 4 十 好 

] 王 -4 十 2x 一 16y 一 4X2 十 2X 

J" =16/ 一 8x 二 2 一 一 64y7 十 16xz 一 8x 十 2 
J4 = -64/ 十 32x 一 8 一 256y 一 64xX 十 32x 一 8 


Thus 
]J (0) = -4() = 一 4 

yy “(0) = 16() = 16 

]y”“(0) = -64() 十 2 = 一 62 

J4(00) = 2560) - 8 = 248 
With 灵 = 0.2 Eq. (a] becomes 

](0.2)] = 工 十 (一 入 (0.2) 十 坟 016) (0.2) 十 村 -62) (0.2)3 十 本 248 (0.2) 
= 一 0.4539 


According to Eq. (7.7) the approximate truncation erTor is 


太一 及 [ 凑 (人 荔 = JJ (0)] 
51 
where 
JG(0) = 248 
JG(0.2) = 256(0.4539) - 64(0.2) 二 32(0.2) -8 = 112.04 


Therefore， 


(0.2) 


51 





(112.04 一 248) = 一 0.0018 


区 到 Initial Value Problems 


The analytical solution yields 





31 1 1 1 
.2)] = 一 e-4029) 2) .2) 一 0.451 
](0.2) 328 十 本 避 ) 80Q ) 弹 0.4515 
so thatthe actual error is 0.4515 -- 0.4539 = 一 0.0024. 


EXAMPLE 7.2 
Solve 


J“ =-0.1Y7 一 X yy0=0 YI=1 
fromx=0to2with the Taylor series method of order four using 球 = 0.25. 


solution With)=yand 思 =Jtheequivalentfirst-orderequations and initial con- 


ditions are 
,| 纺 锣 0 
2 一 0) 一 
全 人 人 [| 


Repeated differentiation of the differential equations yields 
1 轧 四 一 0.1y2 一 区 
一 0.1 坟 一 1 0.01J2 十 0.JX 一 工 
| -0 -1 1 0.01yz 十 0.1x 一 1 
》 二 | oo +o1| 二 | -0001 思 一 00lxz+01 


四 0.01] 坟 十 0.1 一 0.001J2 一 0.01X 十 0.1 
Y 一 
一 0.001 坊 一 0.01 0.0001J2z 十 0.001X 一 0.01 


Thus the derivative array Tequjred by tay]lor is 


防 一 0.1]P2 一 苇 
一 0.1 久 一世 0.01 防 十 0.1X 一 工 
加 0.01 思 十 0.1x 一 1 一 0.001 思 一 0.01x 十 0.1 


一 0.001j2 一 0.01X 十 0.1 0.0001)2 十 0.001X 一 0.01 


which is computed by 


function d = fex7_2(X,Y) 


% Dezrivatives Used in ExXxamp]le 7.2 


d = ZerosS(4,2); 

d(1I,1I) = Y(C2) 1; 

d(1,2) = -0.1*y(2) - X; 

可 《25 和 人 (1 人 

da(2,2) = 0.01*y(2) + 0.1*X - 工 ; 
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7.3 


d(3,1) = qd(2,2); 

Qk3529) 三 =0-001xY(C27 = 0.0132 凋 0 
d(C4,1) = qd(3 ,2); 

d(4,2) = 0.0001*y(2) + 0.001*X - 0.01; 


Here is the solution: 


>> [xX,yY] = taylor(Cefex7_2，0，[0 1]，2，0.25); 
> DamntSol(x YY ID 


习 YI Y2 
0.0000e+000 0.0000e+000 工 .0000e+000 
2.5000e-001 2.4431e-001 9.4432e-001 
5.0000e-001 4.6713e-001 8.2829e-001 
7.5000e-001 6.5355e-001 6.5339e-001 
工 .0000e+000 7.8904e-001 4.2110e-001 
工 .2500e+000 8.5943e-001 1.3281e-001 
1 工 .5000e+000 8.5090e-001 -2.1009e-001 
工 .7500e+000 7.4995e-001 -6.0625e-001 
2.0000e+000 5.4345e-001 -1.0543e+000 


The analytical solution of the problem is 
= 100x 一 5X2 十 990(e-01z 一 ]) 


from which we obtain y(2) = 0.543 45 and y (2) = 一 1.0543, which agree with the nu- 
Imerical solution. 

The main drawback ofthe Taylor series method is thatitrequires repeated differ- 
entiation of the dependent variables. These expressions may become very long and 
thus error-pIone and tedious to compute. Moreover there is the extra work of coding 
each of the derivatives. 


Runge-Kutta Methods 


The aim ofRunge-Kutta methods is to eliminate the needforrepeated differentiation 
ofthe differential equations. Sinceno such differentiation is involvedin the first-order 
Taylor series integration formula 


y(C 十 站 =yO0 十 y (OO 严 =y(X) 十 FROxc,V)P (7.8) 


it can be considered as the first-order Runge-Kutta method; it is also called Eriers 
101e 态 od. Due to excessive truncation error this method is rarely used in practice. 
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(OO 







| 一 Error 


Figure 7.1. Graphical representation of Eulers formula. 
一 Eulers formula 








Let us now take alook at the graphical interpretation of Eulers formula. For the 
Sake ofsimplicity weassumethatthereisasingle dependentvariable j, sothatthe dift- 
ferential equation is y = jx, J).The changein the solution y betweenXandX 十 忆 is 


X 十 忆 X 十 及 
J(X 十 用 一] 月 = 1 ]J dx = JJ)ax 


which is the area of the panel under the (xz plot shown in Fig. 7.1. Eulers formula 
appIoximates this area by the area of the cross-hatched rectangle. The area between 
the rectangle and the plot represents the truncation error. Clearly the truncation 
erIror is proportional to the slope of the plot; that is, proportional to ]“(20). 


Second-Order Runge-Kutta Method 


To arrive atthe second-order method, we assume an integration formula of the form 





yC + 月 =yGOO 二 coF ,IAA+TcE[Ix+ PPYy+9HEC 人 凡 | (9 
and attempt to fnd the parameters co cu Pand qg by matching Eq. (aj to the Taylor 
Series 

y(CX 十 月 = yYCO 十 y( 菇 玉 十 到 Yo 忆 二 O(D) 
= yCO 十 ECc 妨 j 十 5 刃 友 十 OO) (b) 
Noting that 





DEF 2 9F OF 、9F 
EF'(x, V) = 平 > ! 一 > 天 (2X， 
了 习 无 一 3 DX 0 咏 ie 习 


where is thenumber offirst-order equations, we can write Eq. (b) as 
1 / 5F La 
万 = ER 厅 素 二 | 这 二 一 矿 有 3 
yC 十 月 =yCD +EFCc 册 + 让 芋 + 直 ec 十 O(UD) CO 


Returning to Eq. (aj,， we can ITewrite the last term by applying a Taylor series in 
Several variables: 


9F 有 、b 5 
EF[xz+ pzy+9HECc 妨 ] =FGc 念 十 二 大 二 和 琶 互 Cr 刀 +O(UD) 
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So that Eq. (a] becomes 


3F 2 、9F 
y(X 十 月 =Vy(OX 十 (co 十 clD)F(c 妨 有 +cl 攻 1] 十 人 也 且 Ce | 1 +O(13) (gd) 


Comparing Eqs. (c) and (dj, we find that they are identical 证 


co 十 cl=1] ap= 了 aqg= 了 (e) 
BecauseEqs. (e) representthreeequationsinfourunknownparameters, we can assign 
any value to one of the parameters. Some of the popular choices and the names 
associated with the resulting formulas are: 


5E0 一 | P=1/2 9g=1/2 Modified Euers method 
而 二 由 /2 0 2 让 三 荆 7 Heuns method 
co=1/3 ci=2/3 Pp=3/4 9g=3/4 Ralstons method 
All these formulas are classified as second-order Runge-Kutta methods, with no for- 


mula having a numerical Superiority over the others. Choosing the 17odijed Eulers 
101e 妨 od we Substitute the corresponding parameters into Eq. (a) to yield 





忆 忆 
yYC 二 月 =yCO 二 Ex 十 5 十 EC 习 | 旨 
This integration formula can be conveniently evaluated by the following sequence of 
Operations 
Kl = JPF(c, 妨 
玉 库 (z: + 3 (7.9) 
2 7， Y 7 1 


yx 十 万 = y(x) 十 KK 


Second-ordermethods are seldom usedin computer application. Mostprogram- 
mers prefer integration formulas of order four which achieve a given accuracy with 
less computational effort. 






Eigure 7.2. Graphical representation ofmodiftied Euler 
TOX + 2, Y+ K1/2) formula. 





X 
区 X+ 访 


Figure 7.2 displays the graphical interpretation of modified Eulers formula for a 
Single differential equation y = jx, J. The first of Eqs. (7.9) yields an estimate of 
Jy at the midpoint of the panel by Eulers formula: y(x 十 1/2) = JJ 十 xc 妇 1]2 = 
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]J(xz) 十 天 1/2.Thesecondedquation then appIoximates the areaofthepanelbythe area 
天 2 ofthe cross-hatched rectangle. The error here is pIoportional to the curvature ] 
of the plot. 


Fourth-Order Runge-Kutta Method 


The fourth-order Runge-Kutta method is obtained from the Taylor series along the 
samelinesasthe second-ordermethod.Sincethe derivation isratherlongandnotVvery 
instructive, we Skip it. The final form ofthe integration formula again depends on the 
choiceoftheparameters;thatis,thereisnouniqueRunge-Kuttafourth-orderformula. 
The mostpopular version, which is known simply as the Ru728e-KZtta 11etpod, entails 
the following sequence of operations: 





Ki = JECc 们 
刀 下 
号 一 正 (z+ 环 ?+ 卫 ) 
KK 
k= 眉 (z: Pa 汉 (7.10) 


K4 = JPF(x 十 岂 y 十 了 3) 


下 
yx 十 月 =y(O 十 6 下 十 2K2 十 2Ks 十 天 4) 


Themain drawbackofthismethodisthatitdoesnotlenditselfto an estimateofthe 
truncation error. Therefore, we must guess the integration step Size 见 or determine 
it by trial and error. In contrast the So-called adaptive 12etpods can evaluate the 
truncation error in each integration step and adjustthe value ofPaccordingly (but at 
ahigher cost of computation). One such adaptive method is introduced in the next 
article. 


国 UKUt4 


The function runKut4 implements the Runge-Kutta method of order four. The user 
must pIovide runKut4 with the function daqEqs that defines the first-order differential 
equations y' = FE(x, ). 


function [xxSol,ySolL] = runKut4(dqdEqs ,X,y,XStop ,Ph) 
% 4th-order Runge--Kutta :integzration . 

% USAGE : [XxSol,ySolL] = runKut4(dEqs ,X,Yy,XStop ,hy) 
% INPUT : 

% dFEqs = handle of function that Spbpecifies the 
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% 1st-order differential equatIons 
% EFCxX,Y) = [dyl/dx dy2/dx dy3/dqx ...]. 
% 区 7 = :Initial Values; YY must be fow Vector . 


% XStopb = tezrminal Value of 驻 ， 


% hh = Increment of X Used in integration ， 

% OUTPUT : 

% XSol = X-Values at which solution Is computed . 

% YSol = values of Y Corresponding to the X-VvValues . 


If size(y,1) > 1 yyY= yi end %ymustbe zow Vector 
XSol = Zeros(2,1); YySol = Zeros(2 ,LengthCy) ) ; 
XSol(1) 


全 二 下 


葡 贡 交 3DL( 二 小 研 玉 


while X < XStop 
二 = 工 十 工 ; 


Ph = min(h,XxStop - X); 


K1L = hxrfeval(dqdEqs,X,Y) ; 

K2 = hxrfeval(dqdEqs,X + h/2,Yy + KK1X/2) 
K3 = hxrfeval(dqdEqs,X + h/2,Yy + KK2/2) 
K4 = hxrfeval(dqEqs ,x+h,y + K3) 


yY=Yy+(KL + 2xK2 + 2*K3 二 和 4)/6; 
X=X+hi 
XSol(I) = Xi YSol(1I,:) = yY; % Store cuUrrent soln. 


emnd 
EXAMPLE 7.3 
Use the second-order Runge-Kutta method to integrate 
=Ssiny y(0)=1 
fromx= 0to 0.5in steps of 刀 = 0.1. Keep four decimal places in the computations. 
solution Im this problem we have 
xDJ=Siny 

So thatthe integration formulas in Eqs. (7.9) are 

天 1 = Pr 加 =0.1siny 

天 > 一 1 人: | 3. 二 3 一 0.1 sin (+ 5 


JJ 十 六 =JC0 十 天 2 
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Noting that y(0) = 1 we may prIoceed with the integration as follows: 


天 1 = 一 0.1sin1.0000 = 0.0841 








和 = 0.1sin (Looom 平 2 = 0.0863 
y(0.D0 = 1.0+ 0.0863 = 1.0863 
有 = 0.1sin1.0863 = 0.0885 
0.0885 
和 = 0.1sin (1086s 拉 ) = 0.0905 


](0.2) = 1.0863 十 0.0905 = 1.1768 


and so on.Asummary ofthe computations is shown in the table below. 





或 】 天 1 天 2 








0.0 | 1.0000 | 0.0841 | 0.0863 
0.1 | 1.0863 | 0.0885 | 0.0905 
0.2 | 1.1768 | 0.0923 | 0.0940 
0.3 | 1.2708 | 0.0955 | 0.0968 
0.4 | 1.3676 | 0.0979 | 0.0988 
0.5 | 1.4664 



































The exact solution can be shown to be 
XU =ln(cscy -cotJ) 十 0.604582 


which yields x(1.4664) = 0.5000. Therefore, up to this point the numerical solution is 
accurate to four decimal places. However it is unjlikely that this precision would be 
maintained 计 we were to continue the integration. Since the errors (due to truncation 
androundoff)tendto accumulate,longerintegrationTangesrequirebetterintegration 
formulas and more significant fgures in the computations，. 


EXAMPLE 7.4 
Solve 


办 =-0 -7 JJO=0 YYO=1 


fromx=0to2inincrements of 姑 = 0.25 with thefourth-order Runge-Kutta method. 
(This problem was solved by the Taylor series method in Example 7.2.) 
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solution Letting J) =yand yz = ,we write the equjivalent first-order equations as 


Ex 六 允 / 芒 2 
) ] 一 0.1y2 一 区 


which are coded in the following function: 


function 了 = fex7_4(X,Y) 

% Differential. eqs. used :in EXample 7.4 
了 = Zeros(1,2) | 

F(CI) = Y(2); 了 F(2) = -0.1I*Yy(2) - X; 


Comparing the function fex7_4 here with fex7_2 in Example 7.2 we note that 让 
is much simpler to input the differential equations for the Runge-Kutta method than 
for the Taylor series method. Here are the results of integration: 


>> [X,Y] = TuUnKut4(afex7_4,0,[0 1],2,0.25); 
>> PintSol(CX,y,I) 


区 YI Y2 
0.0000e+000 0.0000e+000 工 .0000e+000 
2.5000e-001 2.4431e-001 9.4432e-001 
5.0000e-001 4.6713e-001 8.2829e-001 
7.5000e-001 6.5355e=-001 6.5339e-001 
工 .0000e+000 7.8904e-001 4.2110e-001 
工 .2500e+000 8.5943e-001 1 工 .3281e-001 
工 .5000e+000 8.5090e-001 -2.1009e-001 
工 .7500e+000 7.4995e-001 -6.0625e-001 
2.0000e+000 5.4345e-001 -1.0543e+000 


Theseresults arethesameas obtainedbythe Iaylor series methodin Example 7.2. 
This was expected, since both methods are ofthe same order. 


EXAMPLE 7.5 
Use the fourth-order Runge-Kutta method to integrate 


=3y 一 4e” yyO=1 


fromx=0to 10in steps of 灵 = 0.1. Compare the result with the analytical solution 
一 e 一 . 
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solution The function specifying the differential equation is 


function 了 = fex7_5(x,yY) 
”% Differential eq， used :in Example 7.5. 


FEF= 3x*y - 4x*eXxp(-X)i 
The solution is (every 20th line was printed): 


>> [X,YyY] = TunKut4(aQfex7_5,0,1,10,0.1); 
>>. DIEintSol(X 7207 


区 YI 
0.0000e+000 工 .0000e+000 
2.0000e+000 1.3250e-001 
4.0000e+000 -1.1237e+000 
6.0000e+000 -4.6056e+002 
8.0000e+000 -1.8575e+005 
.0000e+001 -7.4912e+007 


It is clear that Something went wrong. According to the analytical solution, ] 
Should decrease to zero with increasing xz but the output shows the opposite trend: 
after an initial decrease, the magnitude of y increases dramatically The explanation 
is found by taking a closer look at the analytical solution. The general solution of the 
given differential equation is 


= Cesx 十 e 于 


which can be verified by substitution. The initial condition y(0) = 1 yields C = 0, so 
that the solution to the problem is indeed y = e 

The cause oftroublein thenumerical solution is the dormantterm Ce3x.Suppose 
that the initial condition contains a Small error s, So that we have yy(0) = 1 十 s. This 
changes the analytical solution to 


Wenowseethatthe term containing the errors becomes dominant as xis increased. 
Sinceerrorsinherentinthenumericalsolutionhavethesameeffectassmallchangesin 
initial conditions, we conclude that ournumerical solution is the victim of mx72erica/ 
17S12D12) due to sensitivity ofthe solution to initial conditions. The lesson here is: do 
not always trust the results ofnumerical integration. 
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EXAMPLE 7.6 





Aspacecraft is launched at an altitude 互 = 772 km above sealevel with the speed 
Im =6700 my/s in the direction shown. The differential equations describing the mo- 
tion ofthe spacecraft are 
GM。  ， 210 


呈 :2 
大 ET 人 三 
太 厂 





wherer andbo are the polar coordinates ofthe Spacecraft. The constants involved ip 
the motion are 


G = 6.672 x 10-11 mskg ls- = universal gravitational constant 
Me = 5.9742 x 10 汪 kg = mass ofthe earth 


Re = 6378.14 km = radius ofthe earth at sea level 


(1) Derive the first-order differential equations and the initial conditions of the form 
y= 了 下 (LV, y(0) = b. (2) Use the fourth-order Runge-Kutta method to integrate the 
equations from the time oflaunch until the spacecraft hits the earth. Determine O at 
the impact site. 


Solution of Part (1) We have 


GMe = (6.672 x 10- 全 ) (5.9742 x 1024) = 3.9860 x 10 盖 mss 


Letting 
1 三 
| 思 | 一 |7 
二 到 Ja 8 
J/4 2 


the equivalent first-order equations become 


入 J1 
三 世 | Jo0 夫 一 3.9860 x 1014/ 夫 
Js J3 


功 一 2J1]J3/J0 
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with the initial conditions 


7(0) = Re 十 五 = 尺 = (6378.14 二 772) x 103 = 7.15014 x 108 m 

F(0) = 0 

0(0) =0 

6(0) = my/r(0) = (6700) /(7.15014 x 106) = 0.937045 x 10-3 rad/s 
Therefore， 


7.15014 x 106 
0 

0 

0.937045 x 10-3 


y(0) = 


solution of Part (2) The function that returns the differential equations is 


function PE = fex7_6(x,y) 
”% _ Differential eqs， used in Example 7.6. 
E = Zeros( 人 1 ,4); 


FFCI) = Y(C2); 

F(2) = YCL)*y(4) "2 - 3.9860el4/Yy(1) 2 ; 
FF(3) = Y(C4) ; 

EF(4) = -2x*y(2)*y(4)VYCIL) ; 


The program used for numerical integration is listed below. Note that the inde- 
pendent variable iis denoted by x. 


% EXxample 7.6 (Runge-Kutta integration) 
xX=0;Y= [7.15014e6 0 0 0.937045e-3]; 

区 SO 站: 二 工 2003》 五 三 50 Fed 三 23 

[XSol,ySolL] = FunKut4(Qafex7_6,X,y,XStop ,Ph) ; 
PrintSol(CxSol,ySol ,freq) 


Here is the outpnut: 


>> 习 YI Y2 Y3 Y4 

0.0000e+000 7.1501e+006 0.0000e+000 .0000e+000 9.3704e-004 
1 工 .0000e+002 7.1426e+006 -1.5173e+002 .3771e-002 9.3904e-004 
2.0000e+002 7.1198e+006 -3.0276e+002 .8794e-001 9.4504e-004 
3.0000e+002 7.0820e+006 -4.5236e+002 .8292e-001 9.5515e-004 


NDP 避 


7.3 Runge-Kutta Methods 


4.0000e+002 7.0294e+006 -5.9973e+002 3.7911e-001 9.6951e-004 
5.0000e+002 6.9622e+006 -7.4393e+002 4.7697e-001 9.8832e-004 
6.0000e+002 6.8808e+006 -8.8389e+002 5.7693e-001 1.0118e-003 
7.0000e+002 6.7856e+006 -1.0183e+003 6.7950e-001 1.0404e-003 
8.0000e+002 6.6773e+006 -1.1456e+003 7.8520e-001 1.0744e-003 
9.0000e+002 6.5568e+006 -1.2639e+003 8.9459e-001 1.1143e-003 
工 .0000e+003 6.4250e+006 -1.3708e+003 1 工 .0083e+000 .1605e-003 
工 .1000e+003 6.2831e+006 -1.4634e+003 工 .1269e+000 1.2135e-003 
.2000e+003 6.1329e+006 -1.5384e+003 1.2512e+000 1.2737e-003 


The spacecraft hits the earth when r equals Re = 6.378 14 x 105 m. This occurs 
betweent = 1000and1100S.Amoreaccuratevalue offcanbeobtainedbypolynomial 
interpolation. Ino great precision is needed, linear interpolation will do. Letting 
1000 十 Atfbethetime ofimpacb we can write 


Fr(1000 十 Ah = Re 
Expanding7yrin atwo-term Taylor series, we get 
F(1000) 十 FL000)AL = Re 
6.4250 x 105 + (一 1.3708 x 103) Af = 6378.14 x 103 
from which 
Al 一 34.184s 


Thus the time of imnpact is 1034.2 S. 
The coordinate 0 of the impact site can be estimated in a similar manner. Using 
again two terms ofthe Taylor series, we have 


6(1000+ AD 让 = 9(1000) +6(0000)At 
= 1.0083 + (1.1605 x 10-3) (34.184) 
= 1.0480 rad = 60.00" 
PROBLEM SET 7.1 





1，Given 
J +4y7=xz2 JJO=1 


compute y(0.1) using one step of the Taylor series method of order (aj two and 
(b) four. Compare the result with the analytical solution 


1 1，1 1 
e 万 
Ti 





3 
]J/(X) 一 了 
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2. 


Solve Prob. 1 with one step of the Runge-Kutta method of order (a) two and (b) 
four. 


.JIntegrate 


=sny yy(0O)=1 


fromx = 0to0.5 with the second-order Taylor series methodusing 丸 = 0.1.Com- 
pare the result with Example 7.3. 


. Verify that the problem 


] 坟 / J(0) 一 0 


has two solutions:y = 0 andy = (2x/3)3/2. Which of the solutions would be re- 
produced by numerical integration 让 the initial condition is set at (a] y = 0 and 
(bl)y = 10-16?Verify your conclusions byintegrating with anynumerical method. 


.Convertthefollowing differential equations into first-order equations ofthe form 


y' 王 FE(x, J: 


(Iny 二 yy=Sinx 
(bj 区 y 一 xz 一 2 好 =0 
(CO JJ4-4VILI- 夫 =0 


(和 =|327x 一 咏 | 


. In the following sets of coupled differential equations iis the ipdependent vari- 


able. Convert these equations into first-order edquations of the form 文 = 上 (# 刃 : 


(有 ”六 = 一 2 鞠 一 一 郑 
(bj 湖 = -yy( 了 2 十 2) 7 = 一 (和 2 十 刘 
(CO 认 上 +tsiny = 人 4 X 关 十 tcCOSJ 一 4 


1 


. 国 The differential equation for the motion of a simple pendulum is 


C20 8 


where 
0=angular displacement from the vertical 
8 = gravitational acceleration 
工 =length ofthe pendulum 

With the transformation r = 4Vg 工 theequation becomes 


省 一 一 Sinb0 
Cr2 
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Usenumerical integration to determine theperiod ofthe pendulum ifithe ampli- 
tudeisoo = 1rad.Notethatforsmallamplitudes (sn s0)theperiodis2rV 工 /5. 


8. 图 A skydiver of mass 7 in a vertical free fall experiences an aerodynamic drag 
force 了 = cb 也 5 where y is measured downward from the start of the fall. The 
differential equation describing the fall is 


,cba 
三 8 坟 
Determine the time ofa 500 m fall. Useg = 9.80665 my/s2, cb = 0.2028 kg/m and 
10 一 80 kg. 
9， 国 





The spring-mass System is at rest when the force P(UD is applied where 


P 四 二 10IN whent<2s 
| 20N whent>2s 


The differential equation for the ensuing motion is 


PP 大 
】 一 


17 777 


Determine the maximum displacement of the mass. Use 1 = 2.5 kg and 大王 
75 N/m， 


10， 力 





Water level 





5 


The conical float is free to slide on a vertical rod. When the float is disturbed 
from its equilibrium position, it undergoes oscillating motion described by the 
differential equation 


了 = 8(L- qd 
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划 


12， 


13. 


whered = 16 m-3 (determined by the density and dimensions of the foab and 
g=9.80665 my/s2. If the float is raised to the position y = 0.1 m and released， 
determine the period and the amplitude ofthe oscillations， 











The pendulum is suspended from a sliding collar. The System is at rest when the 
oscillating motion y( 轨 =Ysin wofis imnposed on the collar starting at 上 一 0. The 
differential equation describing the motion ofthe pendulum is 


2 

了 8 0 

0 一 一 二 Sinb 十 一 YYcoSsOSsin of 
工 人 和 


Plotb vs.ffromt=0to 10sand determine the largest0 during this period. Use 
g= 9.80665m/sS, 工 =1.0mY=0.25mandow= 2.5rad/s. 





The System consisting of a sliding mass and a guide rod is at rest with the mass 
at7r=0.75m.Attimet=0amotoris turned on that imnposes the motion 0( 三 
(r/12) cosTtontherod.Thedifferentialequation describingtheresultingmotion 
of the Slider is 


六 一 开 - 上 sin ( 二 cos 中 
一 人 了 二 


Determine the time when the slider reaches the tip of the rod. Use g = 9.80665 


mm/S2. 
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14. 


15. 


16. 


上 


Aball ofmass 1 = 0.25 kg is launched with the velocity m = 50 my/s in the direc- 
tion shown. Hthe aerodynamic drag force acting on the ball is 而 = Cpv3”, the 
differential equations describing the motion are 


， Cnp ， 
郑 一 一 -一 0 


CD 12 
二 Js 


wherey = V 记 十 说 .Determinethetime offlightandtherange R.Use Cnb = 0.03 
kg/(m.:s)72 and g = 9.80665 my/s2. 
国 The differential equation describing the angular position 0 of a mechanical 
arm is 
00 一 ] 一 66 
人 
1 十 9 


wherea= 100s- 2 andz=15.I0(00) =2r and0(00) = 0 computeb and0 when 
上 一 0.5 S. 





L= undeformed length 
K= stiffness 


The mass 1 is suspended from an elastic cord with an extensional stiffness Kand 
undeformed length 工 . 坟 the mass is released from rest at 0 = 60” with the cord 
unstretched, find the lengthyr ofthe cord when the position 0 = 0 is reached for 
the first time. The differential equations describing the motion are 


于 
六 = 70 十 gc080 王 一 入 一 巍 
110 


， ”一 270 一 SSij 
广 二 70 一 &Sino0 
厂 
Useg = 9.80665 my/s2, 大 = 40 N/m, 工 = 0.5m and 10= 0.25 kg. 


国 Solve Prob. 15 让 the pendulum is released from the position 0 = 60? with the 
cord stretched by 0.075 m. 








272 


Initial Value Problems 


18. 


19， 


20. 


2 


Considerthe mass-spring System where dry friction is present between the block 
and the horizontal surface. The frictional force has a constant magnitude 78 
(Wis the coefGcient of friction) and always opposes the motion. The differential 
equation for the motion of the block can be expressed as 


大 了 

一 8 姜 
whereyismeasuredfromtheposition wherethespringisunstretched.Iftheblock 
isreleasedfromrestaty = Jo,verifybynumericalintegrationthatthenextpositive 
peakvalue of yis yo - 4/1ag/K(this relationship can be derived analytically). Use 


K= 3000 Nm 1 = 6kg, 人 = 0.5,g= 9.80665 my/s2 and Jo = 0.1 m. 


国 Integrate the following problems fromx=0to20andplot]J vs.X: 


() ] 必 +0502 -DY+Y=0 JJO=1 YYO=0 
(b) J = ycos2x J(0=0 JyO=1 


These differential equations arise in nonlinear Vibration analysis. 


国 The Solution of the problem 
1 
十 YY JU=TL 了 由 =0 


is the Besselfunction 10(00.Usenumerical integration to compute 10(5) and com- 
pare the result with --0.17760, the value listed in mathematical tables. 五 272t to 
avoid singularity at x = 0, startthe integration atX = 10-2. 


国 Consider the initial value problem 
]J”“ = 16.817y 0) = 1.0 ]J (0) = 一 4.1 


(al] Derive the analytical solution. (b) Do you anticipate difhiculties in numerical 
solution of this problem? (c) Try numerical integration fromxXx=0to8tosee 让 
youIr conceIns were justified. 


则 人 
由 
和 








12 





Kirchoff's equations for the circuit shown are 
确 
丰 十 2RG 十 记 一 三 0 ( 


权 十 玉 22 十 2RG2 十 九 ) 一 顾全 (b) 


7.4 Stability and stiffness 


Differentiating Eq. (b) and substituting the charge-current relationship dz/dit = 
zj we get 


di -3R 一 2Rz 二 BO 





(C) 








Ci 工 
di 2 (大 攻 1 cdFE dd 
dl 34 3RC 3R 二 


Wecouldsubstitute dm /dtrfromEq.(cintoEq.(d,sothatthelatterwouldassume 
theusualform dzzy/dit = 太 ,z),butitis more convenienttoleavetheequations 
as they are. Assuming that the voltage source is turned on at time 上 = 0, plot the 
loop currents andz fromt=0to0.05S.UseEOD = 240sin(120rnDVR= 1.09， 
工 =0.2x10-3HandC=3.5x10-3ER 

















22， 国 
上 上 
0000 00000, 
汪 忆 
计 C 十 二 C 
六 启 
己 书 


The constant voltage Source E of the circuit shown is turned on at 一 0 causing 
transientcurrentsm andzzinthetwoloopsthatlastabout0.05Ss.Plotthese currents 
fromt=0to0.05s,usingthefollowingdata: 已 二 9V 尺 =0.258 区 王 1.2Xx 10-3 下 
andC =5x10-3RKirchoff's equations forthe two loops are 





1 ，， 丰 一 史 

工 一 十 玉 三 :下 

可 十 后 十 C 
dz ， 中 吃 
工 一 十 玉 一 一 一 十 夫 = 
大 十 且 72 十 EC 十 C 0 
Additional two equations are the current-charge relationships 

CO 7 一 ; 
下 下 


7.4 _ Stability and Stiffness 


Loosely speaking, amethod ofnumerical integration is said to be stable 让 the effects 
of local errors do not accumulate catastrophically; that is, 过 the global error remains 
bounded. Ifthemethodis unstable, the global error will increase exzponentially even- 
tually causing numerical overflow. Stability has nothing to do with accuracyi in fact， 


an inaccurate method can be very stable. 
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Stabijlity is determined by three factors: the differential equations, the method of 
solution and the value of the increment 及 Unfortunately it is not easy to determine 
Stability beforehand, unless the differential equation is linear. 


Stability of Eulers Method 
Asasimple illustration of stabijlity consider the problem 
J=-X) JJ0O=A (7.11) 
where 和 is apositive constant. The exact solution ofthis problem is 
J00 = be 


Letus nowinvestigate whathappens when we attemptto solve Eq. (7.11) numer- 
ically with Eulers formula 


JJ 二 月 =]JO0 十 网 0 (7.12) 
Substituting ] (0 = 一 人 J(00， we get 
JJ 十 月 =(L 一 人 站 JOO 


开 上 1 一 入 中 > 1 themethod is clearly unstable since |y| increases in every integration 
step. Thus Eulers method is stable only 证 |1 一 入 几 和 卫 OF 


屎 < 2 人 (7.13) 
The results can be extended to a System of 7 differential equations of the form 
yY' 一 一 Ay (7.14) 


where Ais a constantmatrix with the positive eigenvalues 和 Xi 一 1,2,...,1.Itcanbe 
shown that Eulers implicit method ofintegration formula is stable only 让 


严 < 2/)max (7.15) 


where 和 max is the largest eigenvalue of 人 . 


Stiffness 


An initial value problem is called st 六 让 some termas in the Solution vector y(X) vary 
much more rapidly with xthan others. Stiffness can be easily predicted for the differ- 
ential equations Y = --Ay with constant coefficient matrix A. The solution of these 
equations is y(X) = > CiVi exp( 一 和 Xi， where 和 i are the eigenvalues of A and Vi are 
the corresponding eigenvectors. It is evident that the problem is sti 华 让 there is alarge 
disparity in the magnitudes ofthe positive eigenvalues. 


7.4 Stability and stiffness 


Numerical integration of stiff equations requires Special care. The step Size 灰 
needed for stability is determined by the largest eigenvalue 和 max，even 让 the termas 
exp( 一 人 maxXx) in the solution decayveryIapidly and becomes insignificant as we move 
away from the origin. 

For example, consider the differential equationl” 


十 1001 十 1000y=0 (7.16) 


Usingyi=yandyz =]J ,theequivalent first-order equations are 


/ /2 
7 一 1000y1 -1001y> 


居 王 0 一 
1000 ”1001 


The eigenvalues of A are the roots of 


In this case 


一 入 一目 


IAA 于 = 
1000 1001 一 入 








Expanding the determinant we get 
一 入 (1001 一 和 ) 十 1000=0 


which has the solutions 和 1 = 1 and 和 > = 1000. These equations are clearly stiff. Ac- 
cording to Eq. (7.15) we would need 灵 < 2/ 和 > = 0.002 for Eulers method to be stable. 
The Runge-Kutta method would have approximately the same limitation on the step 
Size. 

Whenthe problem is very stift the usual methods ofsolution, sSuch as the Runge-- 
Kuttaformulas,becomeimpractical duetotheverysmall requiredforstability. These 
piIoblems are best solved with methods that are Specially designed for stiff equations. 
Stitfproblem solvers, which are outside the scope ofthis textb have much better stabil- 
ity characteristics; some ofthem are even unconditionally stable. However the higher 
degree of stability comes at a cost 一 the general rule is that stability can be improved 
onlybyreducing the order ofthe method (and thus increasing the truncation erToD). 


EXAMPLE 7.7 
(1) Show that the problem 


19 
4 


// 


]" = 一 107 ]J(0) = -9 ] (0) =0 


17 This example is taken from C.E. Pearson，Nu71zazerical Metjpods 训 BiigizeeTijg a1ad Scie1ice, van 
Nostrand and Reinhold (1986). 
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is moderately stiff and estimate Panax, thelargestvalue ofPfor which the Runge-Kutta 
methodwouldbe stable. (2) Confirm theestimatebycomputingy(10) with 严 Panax/2 
and 灵 S21sx. 


solution of Part (1) With the notation y = yi and y' = yz the equivalent first-order 
differential equations are 


where 


The eigenvalues of A are given by 
一 入 一 1 
IAA 一 和 =|19 =0 
人 


which yields 和 1 = 1/2 and 和 > = 19/2. Because 和 2 is quite a bit larger than 和 Xl, the 
equations are moderately stifft. 


solution of Part (2) An estimate for the upper limit of the stable range of can be 
obtained from Eq. (7.15): 
2 


六 2 二 站 263 
2 








Although this formula is strictly valid for Eulers method, it is usually not too far o 娃 
for higher-order integration formulas. 

Here are the results from the Runge-Kutta method with 妃 = 0.1 (by specifying 
freq = 0inprintSol, onlythe initial and fnal values were printed): 


>> 区 YI Y2 
0.0000e+000 -9.0000e+000 0.0000e+000 
1.0000e+001 -6.4011e-002 3.2005e-002 


The analytical solution is 


19 _， 1 
有 一 X/2 一 19x/2 
内 三 一 一 一 人 一 妇 
]J(CO 7 十 5 


yielding y(10) = -0.0640 11, which agrees with the value obtained numerically. 


7.5 Adaptive Runge-Kutta Method 


With 严 = 0.5 we encountered instabijlity as expected: 


>>> 过 YI Y2 
0.0000e+000 -9.0000e+000 0.0000e+000 
工 .0000e+001 2.7030e+020 -2.5678e+021 


7.5 Adaptive Runge-Kutta Method 


Determination of a suitable step size 灵 can be a major headache in numerical inte- 
gration. 芝 Pistoolarge,thetruncation errormaybeunacceptable; 让 Pis too small we 
are squandering computational resources. Moreover a constant step Size maynotbe 
appiIopriatefortheentirerange ofintegration.Forexample,ifthesolution curve starts 
off with rapid changes before becoming smooth (as in a stiffproblem)j, we should use 
asmall patthe beginningandincrease it as wereach the smooth region. This is where 
Cdaptive71171etpods comein.Theyestimatethetruncation errorat each integration step 
and automatically adjust the step Size to keep the error within prescribed limits. 

TheadaptiveRunge-Kuttamethodsuseso-callede72peddedi72teg7Qtio1.Jjo772U1GS. 
These formulas come in pairs: one formula has the integration order 710 the other 
one is of order 1 十 1. The idea is to use both formulas to advance the solution from 
X to XY 十 凡 Denoting the results by ymn(X 十 万 and yl 十 用, we may estimate the 
truncation error in the formula of order 717 as 


了 E( 站 = yw 十 月 一 ynm(X 十 月 (7.17) 


What makes the embedded formulas attractive is that they share the points where 
FLx,J is evaluated. This means that once ymn(x 十 万 has been computed, relatively 
Small additional effort is required to calculate ym+l(x 十 万. 

Here are the Runge-Kutta embedded formulas of orders 5 and 4 that were orTigi- 
nally derived by Fehlberg; hence they are known as RV118e-KVIC-FePiperg jor72U1asS: 


K1 = PFCxc, D 帮 
ii 07 
K- 严 (s+ any+ak， 1 一 2.3, ,6 
0 
6 
y5(X 十 站 = y(X0) 十 >》， CiK;， (5th-order formula) (7.19a) 


1 一 1 


6 
yaCx+ 月 =y0+》 ,DRK (4tth-orderformula) (7.19b) 
在 演 
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The coeffhicients appearingin theseformulas arenotunique. Thetablesbelowgivethe 
coeffcients proposed by Cash and Karpl18 which are claimed to be an improvement 
over Fehlberg's original values. 















































1 | 4 ii C: 放 
1 37 2825 
378 27 648 
1 1 
2 过 一 0 0 
5 5 
3 3 3 9 250 18575 
10 40 40 621 48384 
4 3 3 9 6 125 13 525 
5 10 10 5 594 | 55296 
11 9 70 35 277 
5 | 1 0 
54 2 27 27 14336 
6 芭 1631 175 575 44275 253 512 1 
8 55296 ”512 13824 110592 4096 | 1771 4 























Table 7.1. Cash-Karp coeftcients for Runge-Kutta-Fehlberg formulas 


The solution is advanced with the fifth-order formula in Eq. (7.19a). The fourth- 
order formula is used only implicitly in estimating the truncation erTOT 


6 
E( 用 =y5(X 十 月 一 十 月 = >》 (Ci 一 ID)K; (7.20) 
记 1 


Since Eq. (7.20) actually applies to the fourth-order formula, it tends to overestimate 
the error in the fifth-order formula. 

Note that E( 有 由 is a vecton its components 玖 ;( 甩 representing the errors in the 
dependent variables ]i… This brings up the question: what is the error measure e( 用 
that we wish to control? There is no single choice that works well in all problems. 下 
we wantto control the largest component ofE( 由 ,the error measure would be 


e( 月 = max| 巨 (站 | (7.21) 


18 JR. Cash and A.H. Carp, 4CM Tazzsactioms om Matpemazatical softare 16, 201-222 (1990). 
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We couldalso control some gross measure ofthe error Such as the root-mean-sSquare 





erIITor defined by 
巨 ( 有 一 玖 2 (站 【7220) 
7 会 
where is the number offirst-order equations. Then we would use 
e( 门 = 无 (月 (7.23) 


for the error measure. Since the root-mean-square error is easier to handle, we adopt 
itfor our program 

Error control is achieved by adjusting the increment 忆 So that the per-step erITOT 
eis appIoximately equal to a prescribed tolerance s. Noting that the truncation erToOT 
in the fourth-order formulais O(jp5j, we conclude that 


e(jJ) (和 5 局 
ep) 下 严 





Let us now Suppose that we performed an integration step with 户 that resulted in 
the error e(J). The step size jP that we should have used can now be obtained from 
Eq. (a] by setting e(j2z) = 8: 


165 
有 = 万 | 击 | (b) 


下 记 > 太 ,wecouldrepeatthe integration step with /2, but since the error associated 
with 启 was below the tolerance, that would be a waste of a perfectly good result. So 
we accept the current step and try jp in the next step. On the other hand, 让 轧 < 户 ， 
we must scrap the current step and repeat it with 户 . As Eq. (bj is only an approxima- 
tion, it is prudent to incorporate a Small margin of safety. In ouI program we Use the 
formula 


1]15 
有 = 0.9 户 | 击 | (7.24) 

Recallthate( 有 appliestoasingleintegration step;thatis,itisameasureofthelocal 
truncation error The all-important globaltruncation erroris dueto the accumulation 
ofthe local errors. What should s be setatin orderto achieve a global error no greater 
than sglobal? Since e(Jm is a conservative estimate of the actual error setting s = sglobal 
will usually be adequate. If the number integration steps is large, it is advisable to 
decrease s accordingly. 

Is there any Ieason to use the nonadaptive methods at all? Usually no; howeve, 
there are Special cases where adaptive methods break down. For example, adaptive 
methods generally do not work 让 F(x, 内 contains discontinuous functions. Because 
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the error behaves erratically at the point of discontinuity the program can get stuck 
in an infinite loop trying to find the appropriate value of . We would also use a 
nonadaptive method ithe output is to have evenly Spaced values of x. 


国 UDKUt5 


The adaptive Runge-Kutta method is implemented in the function runKuts listed 
below. The input argument Pis the trial value ofthe incrementforthe firstintegration 
Step. 


function [xxSol,ySolLl] = TunKut5(dqEqs ,X,y,XxStopb ,heIol) 
% 5th-order Runge-Kutta :integration . 
% USAGE : [XSol,ySolL] = FunKut5(dqEqs ,X,y,XStop,h,eTol) 


% INPUT : 

”% dEFEqs = handle of function that Specifyies the 
% 1st-order differential equations 

% ECx,Y) = [dylL/dx day2/dxz dy3/dx .:-.]， 

% 和 ,Y = :initial Values;i Yy must be fow Vector ， 


% XStopb = tezminal value of X. 


% Ph = trial value of Increment of 和 

% eTol = per-step error tolerance (default = 1.0e-6) . 
% OUTPUT : 

% XSol = X-Values at which solution Is computed . 

% YSol = values of Yy Corresponding to the Xx-Vvalues . 


If Size(y,1) > 1 ;YY=Yy' ii end %ymustbe row Vector 


If nargin < 6; eTIol = 1.0e-6; end 


nn = lengthCy) ; 
A= [0 1/5 3/10 3/5 1 7/8]; 
B = [ 0 0 0 0 0 
1/5 0 0 0 0 
3/40 9/40 0 0 0 
3/10 -9/10 6/5 0 
-1L1/54 5X2 =707Z27 35X27 0 
1631/55296 175/512 575/13824 44275/110592 253/4096] ; 
C = [37/378 0 250/621 125/594 0 512/1771] ; 
D = [2825/27648 0 18575/48384 13525/55296 277/14336 1V/4]; 


% Initialize SolLutIion 

XSol = Zeros(2,1); YSol = zeros(2 ,mn) ; 
天 SO (了 ) 
Stoppem 


训 TSOT(T 人) 三 
0 = 三- 工 ; 
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ftor D = 2:5000 
% Compute 和 "ss from Edq. (7.18) 
K = Zeros(6,D) ; 
K(1,:) = hrfeval(CdqdEqs,X,Yy) ; 
for 工 = 2:6 
BK = Zeros(1,m) ; 
for j = 工 : 工 - 工 
BK BK + BCI, JI*KCJ，:); 


emnd 
民 ( 王 3 


hx*feval(CdEdqs，X + AGi)*h，yYy + BK) ; 
emnd 
% Compute change :in yy and per-Sstep error from 
% Eqs.(7.19) & (7.20) 
dy = Zeros(1,n); 王 = Zeros(1,n) 
for 工 = 1:6 

dy = qy + CCI)*KCI，:); 

也. 三 来 《GE 世人 (7 二 了 (芳和 


e = Sdqrt(Csum( 人 .xx*E)An) ; 
% I error Within tolerance，accept fresults and 
% _ check for terminatIon 


If e <= eITol 


yY=Yy+dyiX=X+ 了 hi 
长 三 放生 工 ; 
XSoL(CK) = Xi YSolCKk,:) = Yi; 
If stopper == 工 ; 
break 
emnd 


end 

% Size of next integtration step from Eq. (7.24) 
If e ”= 0; hNext = 0.9xhx(eTol/e) 0.2; 

else; hNext=h; 

end 

% Check If next Step 1Is the Last one (works 


% with positive and mnegative hh) 


If (hn > 0) == (X + hNext >= XStop ) 
hNext = XStop - Xi Stopper = 1; 

emnd 

Ph = hNext; 


end 
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EXAMPLE 7.8 
The aerodynamic drag force acting on a certain object in free fall can be appIoxi- 
mated by 
而 = 0V2e- 久 
where 


1/ 一 velocity ofthe object in my/s 

]) = elevation ofthe object in meters 

2 一 7.45 kg/m 

= 10.53 x 105m 
The exponential term accounts for the change of air density with elevation. The dif- 
ferential equation describing the fall is 


1= 一 78 十 Z 


where g= 9.80665 my/s” and 1= 114 kg is the mass of the object. 芝 the object is 
Ieleased at an elevation of 9 km, determine its elevation and speed after a 10s fall with 
the adaptive Runge-Kutta method. 


solution The differential edquation and the initial conditions are 





间 2Q .2 
站 二 一 和 万 少 exp (一 DJ/) 


7.45 ， 村 
一 一 9.80665 十 本 三友 exp( 一 10.53 x 10- 5 


y(0)=9000m  JO)=0 


Letting Ji = and )y2 = 力 we obtain the equivalent first-order equations and the 
initial conditions as 


-| 六 |- 2 
四 RE 十 (65.351 x 10-3) y2 exp( 一 10.53 x | 


和 攻 汪 | 


The function describing the diffterential equations is 
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function 了 = fex7_8(X,Y) 
% Diff. eqs， used in Example 7.8 
下 := 三 ZeGmzoOos(CL 2 
EFCI) = Y(27) 1; 
EF(2) = -9.80665... 
+ 65.351e-3 * Y(2) 2 ”* exp(-10.53e-5 * Y(C1L)) ; 


The commands for performing the integration and displaying the results are 
shown below. We specified a per-step error tolerance of 10-” in runKut5. Consid- 
eringthe magnitude ofy, this should be enough forfive decimalpoint accuracy in the 
Solution. 


>> [X,Y] = TunKut5(afex7_8,0,[9000 0],10,0.5,1.0e-2); 
>> PrintSol(Xx,y,1) 


Execution of the commands resulted in the following outpnut: 


>>> 飞 YI Y2 
0.0000e+000 9.0000e+003 0.0000e+000 
5.0000e-001 8.9988e+003 -4.8043e+000 
1 工 .9246e+000 8.9841e+003 -1.4632e+001 
3.2080e+000 8.9627e+003 -1.8111e+001 
4.5031e+000 8.9384e+003 -1.9195e+001 
5.9732e+000 8.9099e+003 -1.9501e+001 
7.7786e+000 8.8746e+003 -1.9549e+001 
工 .0000e+001 8.8312e+003 -1.9519e+001 


The first integration step was carried out with the prescribed trial value 天 == 
0.5s.Apparentlythe errorwas well within thetolerance,sothatthe step was accepted. 
Subsequent step sizes, determined from Eq. (7.24), were considerably larger. 

Inspecting the outputb we seethatat!t= 10sthe objectis moving with the Speed 
/= 一 = 19.52 my/s at an elevation ofy = 8831 m. 


EXAMPLE 7.9 
Integrate the moderately stitf problem 


19 
二 


from x=0to 10 with the adaptive Runge-Kutta method and plot the results (this 
prIoblem also appeared in Example 7.7)， 
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solution Sinceweuseanadaptive method, thereis no needto worryaboutthe stable 
Iange of 见 as we did in Example 7.7. As long as we Specify a reasonable tolerance 
for the per-step error the algorithm will fmnd the appropriate step Size. Here are the 
commands and the resulting output: 


>> [xX,Yy] = TunKut5(Cafex7_7,0,[-9 0],10,0.1); 

>> printSol(CX,Y,4) 

>> 区 YI Y2 
0.0000e+000 -9.0000e+000 0.0000e+000 
9.8941e-002 -8.8461e+000 2.6651e+000 
2.1932e-001 -8.4511e+000 3.6653e+000 
3.7058e-001 -7.8784e+000 3.8061e+000 
5.7229e-001 -7.1338e+000 3.5473e+000 
8.6922e-001 -6.1513e+000 3.0745e+000 
1.4009e+000 -4.7153e+000 2.3577e+000 
2.8558e+000 -2.2783e+000 1.1391e+000 
4.3990e+000 -1.0531e+000 5.2656e-001 
5.9545e+000 -4.8385e-001 2.4193e-001 
7.5596e+000 -2.1685e-001 1.0843e-001 
9.1159e+000 -9.9591e-002 4.9794e-002 
1.0000e+001 -6.4010e-002 3.2005e-002 


The results are in agreement with the analytical solution . 


The plots ofy and y' show everyfourth integration step. Note the high density of 
points near X = 0 where /changes rapidly. As the y -curve becomes Smoother the 
distance between the points increases，. 
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7.6 


Bulirsch-Stoer Method 
Midpoint Method 
The midpoint formula ofnumerical integration ofy' = F(x, y) is 
yC + 月 =yC 一 月 十 27F[x,yO0] (7.25) 


It is a second-order formula, like the modified Eulers formula. We discuss it here 
because it is the basis of the powerful BlLirscPp-9tioer 17e 妨 od which is the technique 
of choice in problems where high accuracy is required. 


J(X) 


Figure 7.3. Graphical repesentation of the midpoint 


xy) formula. 
多 2 ， 
X 


X- 方 X X+ 记 





Figure 7.3 ilustrates the midpoint formula for a single differential equation ]' = 
xc, J).The change in y over the two panels shown is 


X 十 天 


JJ 十 月 一 yx 一 六 = | ]J COdx 


X 一刀 
which equals the areaunder the jy (zx) curve. The midpointmethod approximates this 
areabythe area27j(x,J) ofthe cross-hatched rectangle. 





巍 
Figure 7.4. Mesh used in the midpoint method. 





X MXM 和 和 YY Xn-1 %n 


Considernowadvancingthe solution ofy'(x) = FE(x, fromx=xtox 十 互 with 
the midpoint formula. We divide the interval of integration into 7 steps of length 
六 = 瓦 /2each, as Shown in Fig.7.4, and carry out the computations 





yl =yo 十 PEFo 
y2 三 y0 十 27JF); 
ys 三 刃 十 21F2 (7.26) 


yn 三 Yi-2 十 27PEF1 


Here we used the notation yi = yCa) and Ri = FLG,yi). The first of Eqs. (7.26) uses 
the Euler formula to “seed" the midpoint methodi; the other equations are midpoint 


医 一 Initial Value Problems 


formulas. The final result is obtained by averaging yn in Eq. (7.26) and the estimate 
yz sy-1+AE，available from Euler formula: 





1 
yc 上 + 一 = 了 [w+ (yi+7jn] (7.27) 


Richardson Extrapolation 
It can be shown that the error in Eq. (7.27) is 
E= cij12 二 cz14 二 csj1h6 十 .… 


Herein lies the great utility ofthe midpoint method: we can eliminate as many of the 
leading error terms as we wish by Richardsons extrapolation. For exzample, we could 
compute y(x 十 五) with a certain value of 凡 .and then repeat the process with /2. 
Denoting the corresponding resujlts by g( 甩 and g(P/2), Richardsons extrapolation 一 
See Eq. (5.9) 一 then yields the improved result 
4g(1]/2) 一 g( 用 
3 

which is fourth-order accurate. Another Tound of integration with AP/4 followed by 
Richardsons extrapolation get us sixth-order accuracy' etc. 

Theysin Eqs. (7.26) shouldbeviewedas aintermediate variables, because unlike 
y(xm 十 互 ),they cannotbe refined by Richardsons extrapolation. 





ybetter(20 + 万) 一 


国 mIdqpoInmnt 


Thefunctionmidpoint in this module combines themidpointmethod with Richard- 
Son extrapolation. The first application ofthe midpoint method uses two integration 
steps. The number of steps is doubled in successive integrations，each integration 
beingfollowedby Richardson extrapolation. Theprocedure is stopped when two Suc- 
cessive Solutions differ (in the root-mean-square Sense)j by less than a prescribed 
tolerance. 


function Y = midpoint(CdEqs ,X,Y,XStop ,tol) 
% Modified midpoint method for :intergration of yY” = 了 GCx,Yy) . 
% USAGE: Yy = midpoint(dqEdqs ,XStart,yStart,XStop ,tol) 


% INPUT : 

”% dEqs = handle of function that Feturns the first-ordem 

% differential equations FFCX,y) = [dyl/dx,dqy2/dqx,，...]. 
% X，Yy = initial values;i yy must be a fow Vector ， 


% XStopb = tezminal Value of 斑 ， 


% 七 o1 = per-step error tolerance (default = 1.0e-6) . 
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% OUTPUT : 
% YY = YYCXStop) . 


If size(y,1) > 1 ;YYyY= yi end %ymustbe zow Vector 
If narglin <5; tol = 1.0e-6; end 
kMaxXx = 51; 
n = LengthCy) ; 
zY = Zeros(kMax,n); % Storage for Richardson extrapolation . 
% Start with two :Integration steps . 
DnSteps = 2 
TY(1,1:n) = midCdqdEqs,X,Yy,XStop ,nSteps) ; 
zO1d = ZTC1,1:n) 1; 
for K = 2:kKkMaX 
% Double the number of stepbs & refine Tesults by 
% Richardson extrapolation . 
DnSteps = 2x*K; 
TY(Gk,1:n) = mid(CdqdEqs,X,Yy,XStop ,nSteps) ; 
YY = TichardsonCr ,Kmn) ; 
% Check for convezrgence ， 
到: 三 二 《1 三 9OLd; 
e = Sdqrt(Cdot(dr,dqr)An) ; 
ife <toliy= IT(CL,1:n); return;i end 
zO1d = ZTC1,1:n); 
end 


erTzor( "Midpoint method did pnot converge ) 


下 DG 七 主 O 和 五 二 :证 GhaEdQson( ,五 ) 
% Richardson extrapolation . 
for j = Kk-1:-1:1 
C =(K/CK-1I77 (2*(K-J7 7 ; 
TY(Jj,1:n) =(CCcx*r(J+1,1:n) - TY(J,1:n))/Cc - 1.0) 1 
emnd 


荆 EU 


function yy = mid(CdqEqs ,X,YyY,XStop,nSteps) 
% Midpoint formulas . 

Ph = (CXxStop - X)/nSteps ; 

Y0 = Yi; 

Y1L = Y0 + hx*feval(CdqEdqs ,X,Y0) ; 

for 工 = 1:nSteps-1I 
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又 =X+ 了 hi 
Y2 = YY0 + 2.0x*hxfeval(dqEqs,X,YIL) ; 
Y0 = YL1; 
YI1L = Y2; 
end 
YY=0.5*(yY1 + Y0O + hx*feval(CdEdqs ,X,Y2)); 


Bulirsch-Stoer Algorithm 


When used on its own, the module midpoint has amajor shortcoming: the solution 
at points between the initial and final values of x cannot be refined by Richardson 
extrapolation, so thatyis usable only at the last point. This deficiency is rectified in 
theBulirsch-Stoermethod.Thefundamentalideabehindthemethodis simple: apply 
themidpointmethodin apiecewise fashion. Thatis, advance the solution in stages of 
length 丈 , using the midpoint method with Richardson extrapolation to perform the 
integration in each stage. The value of 妃 can be quite large, since the precision of the 
Iesult is determined mainly by the step length Pin the midpoint method, not by 瓦 . 

The original Bulirsch and Stoertechniquelsa is acomplexprocedurethatincorpo- 
rates many refinements missing in our algorithm. However the function bul1StoeT 
given below retains the essential ideas of Bulirsch and Stoer. 

What are the relative merits of adaptive Runge-Kutta and Bulirsch-Stoer meth- 
ods?TheRunge-Kuttamethodis morerobust havinghighertolerancefornonsmooth 
functionsand stiffproblems.Immostapplicationswherehighprecisionisnotrequired， 
it also tends to be more effGicient. However this is not the case in the computation of 
high-accuracy solutions involving smooth functions, where the Bulirsch-Stoer algo- 
Tithm shines. 


国 DuU]StoeL 


This function contains a Simplified algorithm for the Bulirsch-Stoer method. 


function [xxSol,ySolLl] = bulStoer(dqEdqs ,X,y,XStop ,H,tol) 

% _ Simplified Bulirsch-Stoez method for integration of yY” = 了 CX,Y) . 
% USAGE : [xxSol,ySolL] = bulStoer(dEdqs ,X,Yy,XStop ,H,tol) 

% INPUT : 

”% dEqs = handle of function that Feturns the first-ordem 

% differential equations FFCX,y) = [dyl/dqdx,dqy2/dqx,，...]. 


19 Stoen J,andBulirsch, R., Taztrodvctior io Numaerical 41za1ysis, Springen 1980. 
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% X，Y = initial values;i yy must be a Tow Vector . 


% XStopb = tezrminal Value of 斑 ， 


% 芋 = Increment of X at which solution Is stored . 
% 七 DJ = per-step error tolerance (default = 1.0e-6). 
% OUTPUT : 

% XSol，YyYySol = solution at Increments 匡 . 


If size(y,1) > 1 ;yyY= yi end %ymustbe zow Vector 
If narglin < 6; tol = 1.0e-6; end 
n = LengthCy) ; 
XSol = Zeros(2,1); YySol = Zeros(2,n) ; 
XSol(1) 
全 
while X < XStop 

K=Kd+ 工 ; 

再 = min(H,XxStop - X) 


葡 六 交 9DL( 二 三 


Y = midpoint(dqdEqs,X,y,X + H,tol) ; 


驻 


和 十 了 瑞 ; 
葡 SO]1 (KJ 三 六 ;SORT 三 TY 


emnd 


EXAMPLE 7.10 
Compute the solution of the initial value problem 


=sSsiny yy(0)=1 


atx=0.5 with the midpoint formulas using 刀 = 2and7=4folowedby Richardson 
extrapolation (this problem was solved with the second-order Runge-Kutta method 
in Example 7.3). 


solution With 7 = 2 the step length is 灵 = 0.25. The midpoint formulas, Eqs. (7.26) 
and (7.27), yield 


J=Jo+j 及 =1+0.25sin1.0= 1.210368 
Jo = yo 二 271 太 =1+2(0.25) sin1.210368 = 1.467873 


1 
Jjz(0.5) 了 0 十 yo 十 用 户 ) 


1 
(1.210 368 + 1.467873 十 0.25 sin 1.467 873) 


1.463 459 
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Using 风 = 4wehave 玉 = 0.125 andthe midpoint formulas become 
J1=Jyo+jh=1I+0.125sin1.0 王 1.105184 
yz2=]Jyo 十 21 户 =1+2(0.125) sin 1.105184 = 1.223387 
Jas 三 J1+271 户 = 1.105184 十 2(0.125) sin 1.223387 = 1.340 248 
J4 三]J2z 十 21 户 = 1.223387 十 2(0.125) sin 1.340 248 = 1.466 772 


1 
]J1/2(0.5) 三 04 十 ya 十 几 P) 


1 
= 了 (1.466772 十 1.340 248 十 0.125 sin 1.466 772) 


一 1.465 672 


Richardson extrapolation results in 


4(1.465 672) 一 1.463 459 
](0.5) 三 一 1.466410 


which compares favorably with the “true"” solution y(0.5) = 1.466 404. 





EXAMPLE 7.11 





E(b。 六 


C 











The differential equations governing the loop current ; and the charge qg on the ca- 
pacitor of the electric circuit shown are 


确 ， 9 d9q  ， 
元 +Bi+F=EDO 大 =; 


Ithe appliedvoltage BE is suddenly increased from zero to 9V plotthe resulting loop 
cuIrent during the firstten Seconds. Use 尺 = 1.09, 工 =2HandC =0.45 了 


站 


and substituting the given data, the differential equations become 


5 芒 四 ]J2 
]2 (一 Ryz 一 JIVC 十 万 )/ 


瑟 


solution Letting 
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The initial conditions are 


0 
(下 三 
yY(0) 四 


We solved the problem with the function bulStoer using the increment 瓦 = 
0.5 s. The following program utilizes the plotting facilities of MATLAB: 


% EXxample 7.11 (Bulirsch-Stoezn :integtration) 
[XSol ,ySolL] = bulStoer(Cafex7_11,0,[0 0],10,0.5); 
Pot(xXxSolL ,yYSolL(0:,，2)，，K:oO”) 

grid on 

XLabelL('TITime (人 s) ") 

YLabel(':Current (A) ") 


Current 必 ) 





Recallthatin each interval 束 (thespacingofopen circles) theintegration was peT- 
formedbythe modifed midpoint method and refined by Richardsons extrapolation . 


PROBLEM SET 7.2 





1， Derive the analytical solution of the problem 
]J “十 多 一 3807=0 JJ0=1 ]J (0) = 一 20 


Wouldyouexpect difficulties in solving this problem numerically? 
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2. Consider the problem 
=X 一 107y JJ(0) = 10 


(a) Verifythatthe analytical solution is y(C0 = 0.1x -- 0.01 + 10.01e-lox. (b) Deter- 
minethe step sizejpthatyouwoudusein numerical solution with the nonadap- 
tive) Runge-Kutta method. 

3. 国 Integrate the initial value problem in Prob. 2 fromx=0to 5 with the Runge-- 
Kutta method using (a) 灵 = 0.1; (b) 瑚 = 0.25; and (c) 瑚 = 0.5. Comment on the 
Iesults. 

4. 国 Integrate the initial value problem in Prob.2fromx=0to 10with theadaptive 
Runge-Kutta method. 

D， 国 

K 站 


区 ”- 


The differential equation describingthe motion ofthe mass-spring-dashpot syS- 
tem is 





玫 7 关 
11 11 
where10= 2kgc=460N:s 人 /mand 丰 =450N/m.Theinitial conditions are y(0) 一 
0.01 m and (0) = 0. (a] Showthat this is a stitf problem and determine avalue of 
thatyouwoulduse in numerical integration with thenonadaptive Runge-Kutta 
method. (b) Carry out the integration from t= 0to 0.2 s with the chosen 灵 and 
plotyvS. 志 


6. 国 Integratetheinitial value problem specifiedin Prob.5 with the adaptive Runge-- 
Kutta method fromt 上 = 0to0.2s andplot 了 vs. 夺 


7. 国 Compute the numerical solution of the differential equation 
]J” = 16.817 


fromx=0to2with theadaptive Runge-Kutta method. Use the initial conditions 
(a] y(0) = 1.0, (0) = -4.15 and (b) y(0) = 1.0, (0) = -4.11. Explain the large 
difference in the two solutions. 万 1 derive the analytical solutions. 


8. 国 Integrate 
愉 上 + 一 帮 =0 Jy(0) = 1 ]J/(0) 一 0 


from x= 0to 3.5. Investigate whether the sudden increase in y near the upper 
limit is real or an artifact caused by instabijlity. 万 7 大 experiment with different 
values of 凡 . 
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2. 


10. 


由 


由 


13. 


14. 
5: 


16. 


国 Solve the stiff problem 一 see Eq. (7.16) 
]J“ 二 10017 十 1000y=0 ]J(0) = 1 ] (0) =0 
fromx= 0to 0.2 with the adaptive Runge-Kutta method and plot J VS. X. 
国 SOlVe 
J 史 +27+37=0 JJO=0  JO=Vv2 
with the adaptive Runge-Kutta method fromx=0to5 (the analytical solution is 
= ezsin V220. 
国 Use the adaptive Runge-Kutta method to solve the differential equation 
] 二 2] 
fromx=0to 10 with the initial conditions y(0) = 1 (0) = 一 1.Plot y VS. X. 


国 RepeatProb.11withtheinitial conditions y(0) = 0,] (0) = 1andtheintegration 
IangeX= 王 0to 1.5. 


国 Use the adaptive Runge-Kutta method to integrate 


9 
(二 (= 一 天 | 芒 (Wj 三 5 
灿 ( 了 )) 少 
fromx=0to5andplot yvS.X. 
Solve Prob. 13 with the Bulirsch-Stoer method using 互 = 0.5. 


国 Integrate 


X2] 几 十 XI +y=0  yD=0  yYGD= 一 2 


fromx=1lto20,andplotyandJ' vs.x.Usethe Bulirsch-Stoer method. 


国 
IF xx 
出 


The magnetized iron block of mass 7 is attached to a Spring of stifftness Kand 
free length 工 . The block is at rest atXx 王 工 when the electromagnet is turned om， 
exerting the repulsive force 已 = c/x2 on the block. The differential equation of 
the resulting motion is 


1 大 一 三 一 Kx 一 下 


Determine the amplitude andthe period ofthe motion bynumerical integration 
with the adaptive Runge-Kutta method. Usec=5N -.m2, 大 = 120NAm, 工 = 0.2m 
and 1 一 1.0 kg. 
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17. 


18. 


19. 
20. 























1 
4 一 6 
Thebar 4BC is attached to the vertical rod with a horizontal pin. The assembly 
is free to rotate aboutthe axis ofthe rod. In the absence of friction, the equations 
of motion ofthe System are 
6= 好 singcos6 彤 = -200cotb 


Ifthe system is set into motion with the initial conditions 6(0) = 立 /12 rad, 0(0) 一 
0, b%(0) = 0 and 0%(0) = 20 rad/s, obtain a numerical solution with the adaptive 
Runge-Kutta method fomt=0to1.5sandploty vs. 碟 


国 Solve the circuit problem in Example 7.11 这 民 = 0and 


0whent 一 0 
下 三 . 
9sinrtwhent>0 


国 Solve Prob. 21 in Problem Set 1 这 已 = 240V (constant). 

















四 
上 
E(b)。 入 P。 十 C 
及 记 
二 才 


Kirchoff's equations for the circuit in the fgure are 





十 淹 拓 二 坟 世 古 四 
CE 
z 宁 二 及 也 -和 + 和 =0 
where 
dt 
CE 


Using the data 忆 =48, =1059 了 =0.032 再 ,C =0.53Fand 


20V 计 0 < 夺 < 0.005s 
厂 (三 。 
0 otherwise 


plot the transient loop currents and zz from zt=0to 0.05 S. 
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21. 国 Consider a closed biological system populated by M number of prey and N 
number ofpredators. Volterra postulated that the two populations are related by 
the differential equations 

M=aM--DMN 
N= 一 cvV+TCAMN 
where 咏 canddare constants. The steady-state solution is Mo = c/Q No = CQ/ 已 


让 numbers other than these are introduced into the System, the populations 
undergo periodicfluctuations. Introducing the notation 


JI1=AM/Mo JJ2=NN 
allows us to write the differential equations as 


久 =GUY1 一 切 J2) 

入 = DJa 十 y1y2) 
Usinga= 1.0/yeap 了 = 0.2/year yi1(0) = 0.1 and yz(0) = 1.0, plot the two popu- 
lations from 上 = 0 to 50 years， 


22. 国 The equations 


双 一 一 0U 十 01 
一 CU 一 也 一 
蕊 一 一 D 九 十 Z1 


known as the Lorenz equations, are encountered in theory of fuid dynamics. 
Letting = 5.0, 有 =0.9andc= 8.2, solve these equations from tt 上 = 0to 10 with 
the initial conditions (0) = 0，7(0) = 1.0，w(0) = 2.0 and plot x(. Repeat the 
Solution with c = 8.3. What conclusions can you draw from the resuljlts? 


MIATLAB Functions 


[xSol,ySol] = ode23(qEqs, [xStart,XxStop],yStart) low-order (probably 
third orden adaptive Runge-Kkutta method. The function daEqs mustreturn the 
differential equations as a column vector (recall that runKut4 and runKut5 
Iequire rowvectors). The range ofintegration is from xStart to xStop with the 
initial conditions yStart (also a column vectoD). 


[xSol,ySol] = ode45(dqEqs, [xStart XStop],yStart) issimilartoode23,but 
uses ahigher-order Runge-Kutta method (probably fifth ordeD)， 


区 丽 Initial Value Problems 


These two methods, as well as all the methods described in in this book, belong 
to a goup known as Si178/e-step 1171e 妨 ods. The name stems from the fact that the 
information at a single point on the solution curve is sufficient to compute the next 
point. There are also 10VL6step 711etpods that utilize several points on the curve to 
extrapolate the solution at the next step. These methods were popular once, buthave 
lostsomeoftheirlusterinthelastfewyears.Multistep methodshavetwoshortcomings 
that complicate their imnplementation: 


。 The methods are not self-starting, but must be provided with the solution at the 
first fewpoints bya single-step method. 

。 The integration formulas assume equally Spaced steps, which makes it makes it 
diffticult to change the step size. 


Both ofthesehurdles can beovercome,butthepriceis complexityofthealgorithm 
that increases with sophistication of the method. The benefits ofmultistep methods 
are minimal 一 the best ofthem can outperform their single-step counterparts in cer- 
tain problems, but these occasions are Iare. MATLAB provides one general-purpose 
multistep method: 


[xSol,ySol] = ode1l13(dqEqs, [xStart XxStopb],yStart)uses the variable- 
order Adams-Bashforth-Moulton method. 


MATILAB has also several functions for solving stiftf problems. These are ode15s 
(this is the first method to trywhen a stiff problem is encountered)j, ode23s, ode23t 
and odqe23tb. 


3.1 
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Two-Point Boundary Value Problems 


Solvey 全 省 帮 ( 公 天 7 同人 汪汪)EE 和 


Introduction 


In two-point boundary value problems the auxiliary conditions associated with the 
differential equation, called the pov7zda1y co12difio1s are Specified at two different 
values of x. This seemingly small departure from initial value problems has a major 
Iepercussion 一 itmakesboundaryvalueproblems considerablymore difficultto solve. 
In an initial value problem we were able to start at the point where the initial values 
were given and march the solution forward as far as needed. This technique does not 
work{forboundary value problems, because there are not enough starting conditions 
available at either end point to produce a unique solution. 

One wayto overcomethelackof starting conditions is to guessthemissingvalues. 
Theresulting solution is veryunlikelyto satisfy boundary conditions atthe other end， 
butbyinspectingthe discrepancywe can estimate what changesto maketothe initial 
conditions before integrating again. This iterative procedure is known as the sPpootz78 
711e 态 od. The name is derived from analogy with target Shooting 一 take a shot and 
observe where it hits the target, then correct the aim and shoot again. 

Another means of solving two-pointboundaryvalue problemas is the jzzzte dzjje 六 
e1Ce 111etjod where the differential equations are approximated by finite differences 
atevenlyspacedmeshpoints.Asaconsequence,adifferential equation istransformed 
into set of simultaneous algebraic equations. 

The two methods have a common problem: they give Tise to nonlinear sets of 
equationsifthe differentialequationisnotlinear.Aswenotedin Chapter4,almethods 
of solving nonlinear equations are iterative procedures that can consume a lot of 
computational resources. Thus solution ofnonlinear boundary value problemsisnot 
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3.2 


cheap. Another complication is that iterative methods needreasonably good starting 
values in order to converge. Since there is no set formula for determining these, an 
algorithm for solving nonlinear boundary value problems requires intelligent input; 
it cannotbe treated as a “black box.” 


Shooting Method 
Second-Order Differential Equation 


The simplesttwo-pointboundary value problem is a second-order differential equa- 
tion with one condition speciftied atx = andanother oneatXx 一 履 Hereis an exam- 
ple of a second-order boundaryvalue problem: 


必 = joy yJ0)，JO=aw，JO=A (8.1) 
Let us now attemptto turn Eqs. (8.1) into the initial value problem 
JJ = jj，Jy 因 =c，] 四 =z (8.2) 


The key to success is fnding the correct value of 岂 This could be done by trial and 
error: guess UV and solve the initial value problem by marching from xz 一 Qtoz. 芷 
the Solution agrees with the prescribed boundary condition y(D) = B, we are done; 
otherwise we have to adjustxand try again. Clearly this procedure is very tedious. 

More systematic methods become available to us 让 we reajlize that the determi- 
nation ofvis aroot-fndingproblem.Becausethe solution ofthe initial value problem 
depends on u the computed boundary value y(D) is afunction of w that is 


Jy(D) 一 0(O) 
Hence Vis aroot of 
Fr( 思 =0( 思 一 86B=0 (8.3) 


where 7r(W is the poxv1da1y 7esidxal (difference between the computed and specified 
boundaryvalues).Equation (8.3) can besolvedbyanyone oftheroot-fndingmethods 
discussedin Chapter4.Werejectthemethodofbisectionbecauseitinvolvestoo many 
evaluations ofo( 四 .IntheNewton-Raphsonmethodwerunintotheproblem ofhaving 
to compute d6/dw which can be done, but not easijly. That leaves Brents algorithm 
as OUr method of choice. 

Here is the procedure we use in solving nonlinear boundary value problems: 


1.Specify the starting values 1 and xz which 127sSt Dackerz 妨 e7roof ofEq. (8.3). 
2. Apply Brents method to solve Eq. (8.3) for x. Note that each iteration requires 
evaluation of (IO by solving the differential equation as an initial value problem. 
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3. Having determined the value of & solve the differential edquations once more and 
Iecord the results. 


Ifthe differential equation is linear any root-fnding method will need only one 
interpolation to determine & But since Brents method uses quadratic interpolation， 
itneeds threepoints: zl, 2 and Ia, thelatter being provided by a bisection step. This 
is wasteful since linear interpolation with Vi and xz would also result in the correct 
value of 凡 Therefore, we replace Brents method with linear interpolation whenever 
the differential equation is linear. 


国 InInterp 





Here is the algorithm for linear interpolation: 


function root = 1LinInterp(Cfunc,XL,X2) 
% Finds the Zero of the Linear function f(GxXx) by straight 
”% 1ine :interpolation between X1 and X2 . 


% func = handle of function that Teturns ECX) . 


f1 = feval(Cfunc,X1L); f2 = fevalCfunc,X2) ; 
troot = X2 - f2x*(X2 - X1L)/Cf2 - f1L); 


EXAMPLE 8.1 
Solve the nonlinear boundary value problem 
J “+3)y =0 yy0=0 7y2)=1 


solution The equivalent first-order equations are 


with the boundary conditions 
Ji1(0) 三 0 Ja 三 1 


Now comes the daunting task of estimating the trial values of yz(0) = (0), the 
unspecifed initial condition. We could always pick two numbers atrandom andhope 
for the best. Howeveb it is possible to reduce the element of chance with a jlittle 
detective work. We start bymaking the reasonable assumption that y is smooth (does 
not wiggle) in the interval 0 < X<2.Next wenote that y has to increase from 0 to 1， 
which requires y ”> 0. Since both y and y ”are positive, we conclude that y” mustbe 
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negative in orderto satisfy the differential equation.Nowweareinaposition to make 
arough sketch of y : 





Looking at the Sketch it is clear that y'(0) > 0.5, So thaty'(0) =1and2 appearto be 
Ieasonable values for the brackets of y'(0); 计 they are not Brents method will display 
an elIIOT meSSage. 

In the program listed below we chose the nonadaptive Runge-Kutta method 
(runKut4) for integration. Note that three useI-Supplied functions are needed to de- 
Scribe the problem at hand. Apart from the function qdqEqs(x,y) that defines the 
differential equations, we also need the functions inCond(Cu) to specify the initial 
conditions for integration, and residual(u) that provides Brents method with the 
boundary residual. By changing a few statements in these functions, the pIogram 
can be applied to any second-order boundary value problem. It also works for third- 
order equations 让 integration is started at the end where two of the three boundary 
conditions are Specified. 


function shoot2 
% Shooting method for 2nd-ordezr boundary value problem 


% in Example 8.1. 


glLobal XSTART XSTOP 也 % Make these Params . global. 
XSTARTIT = 0; XSTIOP = 2 % Range of :integration ， 
H=0.1; % Step size. 

freq = 2; % _ Frequency of pintout . 

UL = 1; u2= 2; % Trial values of unknown 


% :initial condition Uu. 


驻 


XSTART 

U = brent(CQ@residual ,ul,u2) ; 

[xxSol,ySolL] = FunKut4(adFEqs ,X, InCond(Cu) ,XSTOP ,H) ; 
printSol(CxSol,ySol ,freq) 


function FEF = dqEdqs(X,Y) % First-ordez different1Ial 
PE = [y(2)，-3x*y(1)*y(2)]; % equations . 


function yY = InCond(Cu) % Initial conditions (u 工 Ss 


歼 三 业 0 机] % the unknown condition) . 
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function TY = Tesidual(Cu)  % Boundary residual . 
glLobal XSTART XSTOP 开 

X = XSTARTI ; 

[xxSol,ySolL] = FunKut4(adFEqs ,X, InCond(Cu) ,XSTOP ,H) ; 
YY = YSol(size(ySolLl ,1),1) - 1 工 ; 


Here is the solution : 


>>> 习 YI Y2 
0.0000e+000 0.0000e+000 1.5145e+000 
2.0000e-001 2.9404e-001 1.3848e+000 
4.0000e-001 5.4170e-001 工 .0743e+000 
6.0000e-001 7.2187e-001 7.3287e-001 
8.0000e-001 8.3944e-001 4.5752e-001 
1.0000e+000 9.1082e-001 2.7013e-001 
工 .2000e+000 9.5227e-001 工 .5429e-001 
工 .4000e+000 9.7572e-001 8.6471e-002 
1.6000e+000 9.8880e-001 4.7948e-002 
1.8000e+000 9.9602e-001 2.6430e-002 
2.0000e+000 1.0000e+000 1.4522e-002 


Note that y (0) = 1.5145, so that our initial guesses of 1.0 and 2.0 were on the 
Iark. 


EXAMPLE 8.2 
Numerical integration of the initial value problem 


]J “二 4y7=4x )J(0)=0 yy (0)=0 


yielded y (2) = 1.653 64. Use this information to determine the value of 7 (0) that 
would result in y (2) = 0. 


solution We use linear interpolation 


&U 一 也 0O(V?) 2 
60 二 900) 





where in ouUr case =J(0) and0(0O = ]J(2).So far we are given 1 =0andb0() 一 
1.653 64. To obtain the second point we need another solution of the initial value 
prIoblem. An obvious solution is y = which gives us y(0) = 0 and y (0) = Jy(C2) = 1 
Thus the second pointis xz = 1 and0(yz) = 1.Linear interpolation nowyields 

1 一 0 


OO=x=1-0 = 2.52 
J(0) =z DT 一 了 96 一 2.52989 


Since the problem is linear no further iterations are needed. 
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EXAMPLE 8.3 
Solve the third-order boundary value problem 


]J"=2) +6xz JJO=2  yG5)=JG)=0 
and plot ] VS. X. 


solution The first-order equations and the boundary conditions are 


JJ ]J2 
y =| 有 才 |= Js 
世 2J/3 十 6XJ'1 


Ji1(0) =2 Ji105) =]2z() =0 


The program listed below is based on shoot2 in Example 8.1. Because two ofthe 
three boundary conditions are speciftied at the right end, we start the integration at 
X=5and proceed with negative 屎 toward Xx = 0. Two of the three initial conditions 
are prIescribed as )1(5) = yz(5) = 0, whereas the third condition ys(5) is unknown. 
Because the differential equation is linear the two guesses for yas(5) (1 and x2) are 
not important; we left them as they were in Example 8.1. The adaptive Runge-Kutta 
method (runKut5) was chosen for the integration. 


function shoot3 
% Shooting method for 3rd-ordez boundary Value 


% problem in Example 8.3. 


glLobal XSTART XSTOP 也 ”% Make these params . glLobal. 


XSTARTIT = 5; XSTIOP = 0 % Range of integration . 

再 三 .三 0. 开 ; % Step size. 

freq = 2; % _ Frequency of Printout ， 
UL = 1; u2= 2; % Trial values of unknown 


% initial condition Uu. 


驻 


XSTART 

inInterp(Caresidual ,ul,u2) ; 

[xxSol,ySolL] = FunKut5(QdFEqs ,X, InCond(Cu) ,XSTOP ,H) ; 
pzrintSol(CxSol,ySol ,freq) 


UL 


function FEF = dqEdqs(X,Y) % 1st-order differential eqs . 
FE = [Y(2)，Y(3)，2*y(3) + 6*Xx*y(CI)]; 


function Yy = inCond(Cu) % Initial conditions . 
Y= [00u]i; 
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function TY = Teslidual(u) % Boundary residual . 
g&Lobal XSTART XSTOP 区 

X = XSTART 

[xxSol,ySolL] = FunKut5(QdFEqs ,X, InCond(Cu) ,XSTOP ,H) ; 
TY = YSol(size(ySolLl ,1),1) - 2; 


We skip the rather long printout ofthe solution and show just the plot: 














HigherOrder Equations 
Consider the fourth-order differential equation 
JJ = jc JJ (8.4a) 
with the boundary conditions 
J(O 一 %1 ]J (da) = oa2 J(D) =Bi ] (四 = (8.4b) 


To solve Eq. (8.4a) with the shooting method weneedfour initial conditions atx 王 必 
only two of which are speciftied. Denoting the two unknown initial values by 1 and 
2, we have the set of initial conditions 


J(G) = al1 J (ad = WU ] (aq = oa2 ]”“(a) = 12 (8.5) 


H 开 Eq. (8.4aj is solved with the shooting method using the initial conditions ip 
Eq. (8.5), the computed boundary values atx 一 已 depend on the choice of xi and z2. 
We express this dependence as 


J(D) =01(U1, 2) ]J“ (各 = 92z(21, 12) (8.6) 


The correct choice of xl and xz yields the given boundary conditions atx = pi;thatis， 
it Satisfies the equations 


01(U, 2) 一 1 02(U1, UV2) = 2 
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or Using vector notation 
ob =O (8.7) 


These are Simultaneous (generally nonlinear) equations that can be solved by the 
Newton-Raphson method discussed in Art. 4.6. It must be pointed out again that 
intelligent estimates of xl and 2 are neededifthe differential equation is not linear. 


EXAMPLE 8.4 





上 网 
V 


The displacementvofthe simplysupported beam can be obtainedby solvingthe 
boundary value problem 
CG417 0X C27 
IT 一 7 了 "= 去 2 0atXx 王 0andx= 一 工 
where ETis the bending rigidity Determine by numerical integration the slopes at 
the two ends and the displacement at mid-span. 








solution Introducing the dimensionless variables 











洲 帮 光 
到 
the problem is transformed to 
047y 02yJ 
二 0 at 0and5 一 1 
下 5 大 3 E 呈 
The equivalent first-order equations and the boundary conditions are (the Prime 
denotes Gd/cd5) 
1 ]2 
/| 芒 Js 
Y 一 一 
J3 J4 
]J4 





Ji10) =Js(0=J=JsU)=0 





The program listed below is simijlar to the one in Example 8.1. With appropriate 
changes in functions dqEqs(x,y),， inCcondCu) and residual(u) the program can 
Solve boundary value problems of any order greater than two. For the problem at 
hand we chose the Bulirsch-Stoer algorithm to do the integration because it gives Us 
control overthe printout (weneedy preciselyat mid-span).Thenonadaptive Runge-- 
Kutta method could also be used here, but we would have to guess a suitable step 
Size 几 . 
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function shoot4 


% Shooting method for 4th-ordez boundary Value 


% pzroblem in Example 8.4. 


gLobal XSTART XSTOP 区 
XSTARTIT = 0; XSTOP = 1 工 ; 


% 
% 


Make these params . glLobal . 


Range of integration . 
Step SiIze， 
Frequemncy of printout . 
Trial values of uU(CIL) . 
and U(2) . 


了 = 0.5; % 
fredqd = 工 ; % 
逢 -三 : 业 人 .二 下 % 
% 
X = XSTARTI ; 
Uu = newtonRaphson2(Qresidual ,u) ; 


[xxSol,ySolL] = bulStoer(CadEdqs ,X, InCond(Cu) ,XSTOP ,H) ; 


pzintSol(xSol ,ySol ,freq) 


function 了 = dqEqs(XxX,Y) 
EPE = [Y(C2) Y(C3) Y(C4) X;]; 


function Yy = InCond(Cu) 
YyY= [0uGL) 0uUG2)]; 


function T = Tesidual(Cu) 
gLobalL XSTART XSTOP 区 
Zezos(1LengthCu) ,1) ; 
XSTART 


至 


驻 


% 


% 
% 


% 


DiIfferential equations . 


Initial conditions; UuU(C1L) 


and uU(2) are Unknowns . 


Boundary residuals . 


[xxSol,ySolL] = bulStoer(CadEdqs ,X, InCond(Cu) ,XSTOP ,H) ; 


astRow = SIze(ySol ,1) ; 
TC1)= YSol(lastRow,1) ; 
T(2) = ySolL(LastRow,3); 


Here is the outpnut: 
学 区 YI 


0.0000e+000 0.0000e+000 
5.0000e-001 6.5104e-003 


于 
于: 


Y2 郝 马 
9444e-002 0.0000e+000 
2150e-003 -6.2500e-002 


.0000e+000 -4.8369e-017 -2.2222e-002 -5.8395e-018 


Noting that 


dl dd 





de ds5cdx 


Wo dgN1L zuo7D 吵 
BT d85/ LI FT dE 


Y4 
-1.6667e-001 
-4.1667e-002 

3.3333e-001 
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we obtain 
3 
灾 | -19444x 10-3zo 
(到 | 0 瑟 了 
Cc 0 
ee 一 一 22.222 x 10 
EX 7 





Z00 工 4 

ET 

which agree with the analytical solution (easily obtained by direct integration of the 
differential equation). 


咱 z -057 一 6.5104 x 10-3 


EXAMPLE 8.5 
Solve the nonlinear differential equation 


4 
gg 二 v3-0 
了 
with the boundary conditions 
]J(0) = (0) =0 yy (=0 JJ “=1 
and plot ] VS. X. 


solution Our first task is to handle the indeterminacy of the differential equation 
at the origin, wherex 一 y = 0. The problem is resolved by applyingLHospitals rule: 
4y3/X 一 12y2y asx 一 0.Thustheequivalentfirst-orderequationsandtheboundary 
conditions that we use in the solution are 


， J2 

J1 功 

y'= 了 2 ] 
上 一 12J?y> nearx=0 
了 4 一 4Ji/xz otherwise 


JiO0=JozO0=0 JaD=0 JJMO=1l 


Because the problem is nonlinear we need reasonable estimates for y“(0) and 
]y”“(0). On the basis of the boundary conditions y “上 ) = 0 and y“() = 1 the plot of 
]J ”is likely to look something like this: 


下 


包 
0 1 二 |! 
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HIwe areright then]y (0) < 0andy“(0) > 0.Basedon this rather scantyinformatiom， 
we try]y (0) = -1andy (0) = 1. 

The following program Uses the adaptive Runge-Kutta method (runKut5) for 
integration: 


function Shoot4n1 
% Shooting method for nonlinear 4th-order boundary 


% value Problem :in Example 8.5. 


gJLobal XSTART XSTOP 开 % Make these Params .global . 
XSTARI = 0; XSTIOP = 工 ; % Range of integtration . 
再- 三 从 :于 ; % Step size . 
fredq = 工 ; % _ Frequency of Printout . 
U= [-11]; % Trial values of UuU(C1) 
% and U(C2) . 
X = XSTART 
U = newtonRaphson2(Qresidual ,u) ; 


[XSol,ySolL] = FunKut5(QdEqs ,X, InCond(Cu) ,XSTOP ,H) ; 
pzintSol(CxSol ,ySolL ,freq) 


function 了 = qEdqs(CX,Y) % Differential equations . 
PE = Zeros(1,4); 
F(I) = Y(2); F(2) = Y(3); FF(3) = Y(C4) 1; 


IEfX< 10.0e-4; F(4) = -12x*xyC2)x*y(1) 2; 

else; EF(4) = -4*(y(C1) 3)7V/X; 

end 

function Yy = InCond(Cu) % Initial conditions; U(CL) 
YY= [00UuUCL) U(C2)]; ”% and uUu(2) are Unknowns . 


function TY = residual(GCu)  % Bounday Tesliduals . 
gLobal XSTART XSTOP 区 

zZ = Zeros(1LengthCu) ,1L); 

X = XSTART 

[XSol,ySolL] = FunKut5(QdEqs ,X, InCond(Cu) ,XSTOP ,H) ; 
astRow = Size(YySolL ,1) ; 

TY(1) = yYSolL(LastRow,3) ; 

TYT(2) = yYSolL(1LastRow,4) - 1 工 ; 
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The results are: 
























>> 飞 YI Y2 Y3 Y4 
0.0000e+000 0.0000e+000 0.0000e+000 -9.7607e-001 9.7131e-001 
工 .0000e-001 -4.7184e-003 -9.2750e-002 -8.7893e-001 9.7131e-001 
3.9576e-001 -6.6403e-002 -3.1022e-001 -5.9165e-001 9.7152e-001L 
7.0683e-001 -1.8666e-001 -4.4722e-001 -2.8896e-001 9.7627e-001 
9.8885e-001 -3.2061e-001 -4.8968e-001 -1.1144e-002 9.9848e-001 
工 .0000e+000 -3.2607e-001 -4.8975e-001 6.4879e-016 工 .0000e+000 
0.000 
| 
-0.050 三 -一 一 -一 - 十 -一 一 一 上 
1 1 
-0.100 上 CT 一 上 一 一 一 
050 上 一 一 一 
ao 一 
厂 | | | 
-0.250 上 -一 --- |- 二 -一 一 十 PS 
| | | 1 
六 | 1 
人 
恬 | | 1 1 
-0.3S0 1 | | | 1 | | 1 
0.00 0.20 0.40 0.60 0.80 1.00 
券 
Bygoodfortune, ourinitial estimates y“(0) = --1andy“(0) = 1were very closetothe 


fnal values. 


PROBLEM SET 8.1 





1. Numerical integration of the initial value problem 
J +) -JJ=0 JJO=0 yyO=1 
yielded y() = 0.741028. What is the value of y (0) that would result in y() = 了 


asSsuming that y(0) is unchanged? 


2. The solution of the differential equation 


了 7 十 JJ/ 十 2]J/ 一 6 
with the initial conditions y(0) = 2，y (0) =0 and 7y”(0) = 1 yielded 7y() = 
3.03765. When the solution was repeated with 7y”“(0) = 0 (the other conditions 
beingunchanged), theresultwas y() = 2.72318. Determine thevalue ofy“(0) so 
that y() = 0. 
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3. Roughly sketch the solution of the following boundary value problems. Use the 
Sketch to estimate (0) for each problem. 
(a]) JJ 王 一 e ]J(0) 一 1 (1) =0.5 
(b) ] 才 =4]7 )J(0)=10 yyOD=0 
(C) ]J ”= cos(XJ) ]J(0) 一 1 Jy() 三 2 


4. Using arough sketch of the solution estimate of y(0) for the following boundary 
value problems. 


(aj J 区 三 ] 了 2 十 zy )J(0=0 yyOD=2 
人 2 / 2 / 

须 更 二 = = 了 网 二 JE 

(C] JJ 三 一 X(OY)? y(0=2 yyD=1 


5. Obtain arough estimate of y“(0) for the boundary value pIoblem 
于 站 
y0)=0  yO0O=1 yyD=0 
6. Obtain rough estimates of y“(0) and y”“(0) for the boundary value problem 
J4+2 必 十 siny=0 
]J(0) =]J (0) =0 天 及 二 5 yy“() =0 
7. Obtain rough estimates ofX(0) and )(0) for the boundary value pIoblem 
5+T22-y=-0 xx0=1 xd)=0 
y+] 记 -2x=1 JJ0O=0 JJD=1 
8. 国 Solve the boundary value problem 
J+(=-0.202=0  y0O=0 yor/)=1 
9. 国 Solve the boundary value pIoblem 
] 上 27 +37 =0  JyJ0O=0 7yO2)=-=-1 
10. 国 Solve the boundary value problem 


] “+siny 十 1=0 ]J(0) =0 J(r)=0 
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11. 国 Solve the boundary value problem 
1 
]J” 十 十 y=0 y(0.01) = 1 ]J (2) =0 


and plot y vs. X. WU17118:) changes veIyIrapidly nearx = 0. 


12. 图 Solve the boundary value problem 
J-(L-e)y=0 JJ0O=1 ycol=0 


andplotyVvs.X. 71 大 Replacethe infinitybyafinite value 8. Checkyour choice of 
6 byrepeating the solution with 1.568. 玉 the results change, you must increase 8. 


13. 国 Solve the boundary value problem 


人 


下 3 
] 三 和 十 浆 ] 十 0.1() 
yD=0 yyYD=0 7y2)=1 

14. 国 Solve the boundary value problem 

]J “十 4 十 6 = 10 

J(0) =J (0) =0 J(3) 一 (3) = 5 

15. 国 Solve the boundary value problem 

])y “十 2 "+Ssiny=0 

J(-DJ =0 ]J (-D = 一 ! yy GD)=1 
16. 国 Solve the differential equation in Prob. 15 with the boundary conditions 
J(-DJ=0 ]J(0) =0 机 有 宇 


(this is a three-pointboundary value problemy). 


17. 国 Solve the boundary value problem 


)J(0=5 JIO0O=0 JJD=0 yy”D=2 
18. 图 Solve the boundary value problem 
J 鸭 二 一 2]JJ7 


]J(0) = yy (0) = 0 (=0 yb =1 


311 | 8.2 Shooting Method 


9 


20. 


2 


北 Wm 


6 
t=0 8000m 1=1087 





A projectile of mass 7 in free fight experiences the aerodynamic drag force 
而 = c7, where vis the velocity The resulting equations of motion are 


郊 一 和 六 一 “ 刀 
二 半 二 一 帮 以 “8 


Hthe projectile hits a target 8 km away after a 10 s flight, determine the launch 
velocity mw and its angle ofinclination 6. Use 1= 20 kg,c=3.2 x10-kg/mand 
g = 9.80665 my/s2. 

国 


Wo 
人 AN 



























































V 


The simply supported beam carriesauniform load ofintensity wo andthe tensile 
force V. The differential equation for the vertical displacement 7 can be shown 
to be 


dd Nad2y un 


cx4 BTadxz2 BT 





where BTis the bending rigidity The boundary conditions arey = d2v/dxc =0 





7 
atx 王 0andx 王 工 .Changing the variables to 一 了 and ) 一 TI transforms 





了 
0 
the problem to the dimensionless form 

2 _p2Y _ 8- NTE” 

CE CE2 BT 

Gd2yJ 02J 
Js=o0 二 =Jl=-I= zl =0 
082|。 0 2 082 1.1 


Determine the maximum displacement 计 (al) 8 = 1.65929 and (b) 8 = 一 1.65929 
(Vis compressive). 


国 Solve the boundary value problem 


AAA 


JJ 十 东 /=0 JJ0O=y (0=0Jy co)=2 
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3.3 


andploty(z andy (0.This problem arises in determining the velocity profile of 
the boundary layer in incompressible flow (Blasius solution). 


Finite Difference Method 











Eigure 8.1. Finite difference mesh 


Inthefinite difference method we divide the range ofintegration (Q, 刀 into 妈 一 1 


equal subintervals oflength Peach, as Shown in Fig. 8.1. The values ofthe numerical 
solution at the mesh points are denoted by 区, = 1,2...,7;the two points outside 
(, 丰 wil be explained shortly We then make two approximations: 


The derivativesofy inthe differentialequation arereplacedbythefinite difference 
expressions. It is common practice to use the first central difference approxima- 
tions (See Chapter 5): 


2 = 一 2 入 十 及 Ht 


只 5 | 庆 etc. (8.8) 


The differential equation is enforced only at the mesh points. 


As a result the differential equations are replaced by 7 Simultaneous algebraic 


equations,the unknowns being 太 ,= 1 2,....1.Ifthedifferential equation is nonlin- 
ear the algebraic equations will also benonlinear and mustbe solvedbythe Newton- 
Raphson method. 


Since the truncation error in a first central difference approximation is O(722)， 


the finite difference method is not as accurate as the Shooting method 一 recall that 
the Runge-Kutta method has atruncation error of O(15).Therefore, the ConVvergence 
criterion in the Newton-Raphson method should not be too Severe. 
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Second-oOrder Differential Equation 
Consider the second-order differential equation 
]J = joy] 
with the boundary conditions 
Jy(d=a or (dg =w 
J(D=6 or 人 = 有 


Approximating the derivatives at the mesh points by finite differences, the prob- 








lem becomes 
2 ; 六 二 
Ji-1 了 十 Jrl _ (六 二 中 ， 站 2054 (8.9) 
JJ 一 c OL 于 一 0 (8.10a) 
人 二 二 = (8.10b) 


Notethepresence ofyoandJm+l which areassociatedwithpoints outsidethe solution 
domain (, 及. This “spilover”can be eliminated by using the boundary conditions. 
Butbefore we do that, let us rewrite Eqs. (8.9) as 





加 一 2 二 六 瑟 人 (二 站 闪 有) = (al) 
Ji 1 一 2 十 Ji 一 有 2 了 (二 和 和 -0 1=-23..7-1 (D) 
JP-1 一 2 功 十 Jr+l 一 7] 太 (> J/， 瑟 2 一 0 (C) 


The boundary conditions on )y are easily dealt with: Eq. (aj is Simply replaced 
byJ 一 xw=0andEq. (c is replaced by 切 一 68=0.I 开 are prescribed we obtain 
fromEqs. (8.10) yo = yz 一 21aandy+l=J1+2168,whicharethensubstitutedinto 
Eqs. (a] and (cj, respectively. Hence we finish up with 2 equations in the unknowns 
2 


嫉 -w=0 | 


二 用 上 
-2J1 十 2yJ2 一 12 Fi]a) 一 2po =0 让 yag =w Re 


Ji 一 2 攻 十 攻 1 一 局 站 ( 裤 区 2 -0i=23 7-1 (11D) 





甸 -8=0 让 y(D) = 8 | 人 


2Jp 1 一 2] 二 有 三 Con J/， 有 ) 提 2718 =0 让 J( 亿 和 有 


七 一 Two-Point Boundary Value Problems 


EXAMPLE 8.6 
Write out Eqs. (8.11) for the following linear boundary value problem using 刀 = 11: 


]J“= -4y 十 4x JJ(0=0 ] (r/2) =0 
Solve these equations with a computer pIOgram. 


solution In this case w=0 (applicable to J，68=0 (applicable to y) and 
FJ yy = -47 十 4x.Hence Eqs. (8.11) are 


J1=0 
JJ 1 一 2 入 二 JI 一 1 (一 4 大 十 406) = 0， = 2,3,. ,10 
2Jio 一 2 一 12(-4J 十 4xi) =0 


op using matrix notation 


1 0 功 ! 0 
1 -2 二 412 1 ]/2 472Xp 
1 一 2 十 412 1 Ja0 472X10 
2 一 2 十 47 J11 472X11 


Note thatthe coeffticient matrixis tridiagonal so thatthe equations can be solved 
efhiciently by the functions LUdec3 and LUso13 described in Art. 2.4. Recalling that 
these functions store the diagonals of the coeffhicient matrix in vectors c, d and e, we 
arrive at the following program: 


function fDiff6 
% Finite difference method for the second-ordez， 


% 1inear boundary value problem in Example 8.6. 


XStart = 0; XStop = DIV/2 % Range of integration ， 
nm = II; % Number of mesh points . 
freq = 工 ; % Printout frequency ， 


Ph = (CXStopPp - XStart)/Cn-1) ; 


驻 


inspbpace(xStart ,XStop ,n) ”; 
[rc,dq,e,b] = fDiffEqs(Cx,h,n); 
[rc,d,e]l = LUdec3(Cc ,de)i 
PrintSol(X,LUsol3(Cc,de,b) ,freq) 
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function [c,d,e,b] = fDiffFEqs(X,h,n) 

% Sets Up the tridiagonal coefficient matriIx and the 
% constant Vector of the finite difference equations . 
h2 = hxh; 

ones(n,1)*(-2 + 4xh2) ; 


ones(Cn-1,1) ; 


ones(Cn-1,1); 
ones(n,1)*4x*h2.x*X; 
(1) = 1; e(1L) = 0; b(C1) = 0;cCn-1L) = 2; 


己 In D PR 
中 


The solution is 


>> 于 YI 

0.0000e+000 0.0000e+000 
工 .5708e-001 3.1417e-001L 
3.1416e-001 6.1284e-001 
4.7124e-001 8.8203e-001 
6.2832e-001 工 .1107e+000 
7.8540e-001 工 .2917e+000 
9 .4248e-001 工 .4228e+000 
工 .0996e+000 1.5064e+000 
1.2566e+000 1.5500e+000 
1.4137e+000 1.5645e+000 
1.5708e+000 1.5642e+000 


The exact solution of the problem is 
了 王 :天 = Sm 2X 


which yields y(r/2) = /2 = 1.57080. Thus the error in the numerical solution is 
about 0.4 兄 . More accurate results can be achieved by increasing 17. For exzample, with 
1= 101 we would get y(r/2) = 1.57073, which is in error by only 0.0002 兄 . 


EXAMPLE 8.7 
Solve the boundary value problem 


) =-3] JJODO=0 JJO=1 


with the finite difference method. (This problem was solved in Example 8.1 by the 
Shootingmethod.) Use17= 11andcomparetheresultsto the Solution in Example 8.1. 


solution As the problem is nonlinear Eqs. (8.11) must be solved by the Newton- 
Raphson method. The program jlisted below can be used as a model for other 
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Second-order boundary value problems. The subfunction residual(Cy) returns 
the residuals of the finite difference equations，which are the left-hand sides of 
Eqs. (8.11). The differential equation “= jx,],y is deftined in the subfunction 
Y2Prime. In this problem we chose for the initial solution 久 = 0.52，which cor- 
IeSponds to the dashed straight line shown in the rough plot of y in Example 8.1. 
Note that we relaxed the convergence criterion in the Newton-Raphson method to 
1.0 x 10-5, which is more in line with the truncation error in the finite difference 
method. 


function fD1Iff7 
% Finite difference method for the second-ordez， 


”% nonlinear boundary value ProbJlem :in Example 8.7. 


glLobal N 互 X ”% Make these params . glLobal. 
XStart = 0; XStop = 2 % Range of :integration . 

N = 1IIL; % Number of mesh points ， 
freq = 工 ; % Printout frequency . 


X = linspace(CxStart,XxStop ,N) ; 
= 0.52x*Xi % Staprting Values of Y. 


芋 


Y 
printSol(X,y,fred) 


(XStopP - XStart)/CN-I) ; 
newtonRaphson2(CQresidual ,y,1.0e-5); 


function TY = TeslidualL(CyY) ; 
% Residuals of finite difference edquations (eft-hand 
% Sides of Eqs (8.11)) . 
g&LobalL N 也 X 
T = ZeTos(CN ,1) ; 
T(CI) = Y(C1); TYCN) = YCN) - 1 工 ; 
for 工 = 2:N-I 

T(Ci) = YCi-1) - 2*y(i) + YCi+1)... 

= 末了 六 2 工 瑟 me( 欠 CI)7YCDOwCYCIHLJ = 六 (IT=120742xID 03 


end 


function EF = Y2Prime(X,y,yYPrime) 


% Second-ordez differential eduation 了 = Y 


了 = -3*yxyPTrime 


8.3 Finite Difference Method 


Here is the output from the program: 


>> 飞 YI 
0.0000e+000 0.0000e+000 
2.0000e-001 3.0240e-001 
4.0000e-001 5.5450e-001 
6.0000e-001 7.3469e-001 
8.0000e-001 8.4979e-001 
1.0000e+000 9.1813e-001 
1.2000e+000 9.5695e-001 
工 .4000e+000 9.7846e-001 
1.6000e+000 9.9020e-001 
1.8000e+000 9.9657e-001 
2.0000e+000 1.0000e+000 


The maximum discrepancy between the above solution and the one in Exam- 
ple 8.1 occurs atXx = 0.6. In Example 8.1 wehave y(0.6) = 0.072187, so that the differ- 
ence between the solutions is 


0.073469 一 0.072187 


100% 工 
0.072187 人 





As the shooting method used in Example 8.1 is considerably more accurate than the 
finite difference method, the discrepancy can be attributed to truncation errors in 
the finite difference solution. This error would be acceptable in many engineering 
piIoblems. Again, accuracy can be increased by using a finer mesh. With = 101 we 
can reduce the error to 0.07 兄 , but we must question whether the tenfold increase in 
computation time is really worth the extra piecision. 


Fourth-Order Differential Equation 


FEor the sake ofbrevity we limit our discussion to the Special case where y' and y” do 
notappear explicity in the differential equation; that is, we consider 


J4 = Fo yy 


We assume that two boundary conditions are prescribed at each end of the solution 

domain (C, 忆 . Problems of this form are commonly encountered in beam theory. 
Again we divide the solution domain into 71- 1 intervals of length /each. Re- 

placing the derivatives of y by finite differences at the mesh points, we get the finite 
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difference equations 























;2 一 4J 1 十 6 和 一 4 十 其 1 一 2 芒 十 芒 
其 -2 共 -1 庆 5+1 十 攻 上 +2 一 (am 六 -1 六 2 (8.12) 
wherei = 1,2,...,1.Itis more revealingto write these equations as 
一 2]1 十 
J 1 一 4y0+6J1 一 4yj2 十 ya 一 挨 太 (= ]1， 多 记 所 ) 三 0 (8.13a) 
一 2]J2 十 
加 一生 二 6 一 95 二 用 一下 人 (总攻 交 渤 所 ) =0 (8.13Db) 
一 2]J3 十 
力 一 4 十 6J3 -404 十 J5 一 ij( 站) =-0 (8.130) 
_2 一 2J7 1 十 
JJpr-3 一 4J-2 十 6JJ -1 一 4 入 十 Jrl 一 ip1(s hp-1， 一 所 ) 一 0 (8.13d) 
_1 一 2 切 十 
护 =2 一 4J-1 直 6J/ 4Jm+1l 十 Jr+2 一 太太 (者 JJ 2 区 2 三 息 (8.13e) 


Wenowseethattherearefourunknownsthatjlie outside the solution domain: jl1, yo， 
Jm+landJmra2.This“spillover canbeeliminatedbyapplyingtheboundary conditions， 
ataskthat is facilitated by Table 8.1. 





Bound. cond. | Equivalent fnite difference expression 





(OO 一 caw | 三 w 
]J (四 =aw | Jo=J 一 217a 
JJO=a | yo=21 一 J2 十 ja 
JJ=aw | =2yJ0o 一 2y72 十 J3 一 213a 
]J(D) =6 | 和 轨 = 有 
] (局 三 双 Jr+l 三 ]-1 十 2718 
]“( 丰 王 履 Jr+1l 一 2] 功 一 Jp -1 十 128 
]7( 丰 一 有 Jp+2 一 2Jhp+l 一 2]J/_l 十 J-2 十 2138 


Table 8.1 

















The astute observer maynotice that some combinations ofboundary conditions 
winotworkin eliminatingthe“spilover” One Such combination is clearlyy(o) = w1 
and y”“(q) = ax2. The other one is y (dg) = xl and y“(qg) = wz. In the context of beam 
theory this makes sense: we can impose eithera displacementyorashearforce 已 7TJy 7 
at apoint but it is imnpossible to enforce both of them simultaneously. Similarly 让 
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makesno physical senseto prescribeboththeslopey andthebendingmoment ET 
atthe same point， 


EXAMPLE 8.8 








双 | 蝇 - 


Theuniform beam oflengthZLandbendingrigidityE7Tis attachedtorigidsupports 
at both ends. The beam carries a concentrated load P at its mid-span. 广 we utilize 
Symmetryandmodelonlythelefthalfofthebeam,the displacementyvcanbeobtained 
by solvingthe boundary value problem 





吕 0 
CX4 
人 人 Cd37 
zlx=0 王 0 一 0 顾 7 一 一 一 一己 /2 
和 GxX|:-0 GxX| :ra 0 XI/2 








Use the finite difference method to determine the displacement and the bending 
moment M= -BET(d2v/dx2) atthemid-span (the exact values arez = PL3/(1925 站 
and M= PL/8). 
solution By introducing the dimensionless variables 

元 ET 








the problem becomes 
4 
到 
GE 
志 志 03]J/ 1 
J/| 二 0 一 0 一 一 = 一 一 一 
GE5|:-0 Gd5|1:-12 d853|5-12 2 


We now proceed to writing Eqs. (8.13) taking into account the boundary condi- 
tions. Referring to Table 8.1 we obtain the finite difference expressions ofthe bound- 
ary conditions at the left end as yi1 = 0 and )o = yz2. Hence Eqs. (8.13a) and (8.13b) 
become 


JJ =0 (a) 
-41+7j2 一 4J3+Jn=0 加 
Equation (8.13c) is 


J1 一 4y2 十 6)y3 一 4J4 十 芒 = 三 0 (C) 


区 到 Two-Point Boundary Value Problems 


Atthe mid-span the boundary conditions are equivalent to Jrl = JJ-1and 





Jnr+2 三 2JMm+l 2J 加 1 功 -> 十 213( 一 172) 





Substitution into Eqs. (8.13d) and (8.13e) yields 
Jp-3 一 4J0-2 业 7J0p-1 4] =0 (dg) 
2]Jh 2 一 8 -1 十 6] 三 思 3 (e) 


The coefhicient matrix of Eqs. (90)-(e) can be made symmetric by dividing Eq. (e) by 2. 
The result is 


下 0 0 JJ1 0 
0 7 一 4 1 ]J/2 0 
0 一 4 6 一 4 业 ]J3 0 
1 -4 6 -4 1 和， 0 
1 -4 7 -4 0 

1 -4 引入 0.57123 


The above System of equations can be solved with the decomposition and back 
Substitution routines in the functions LUdec5 and LUsol15 一 See Art. 2.4. Recall that 
these functions work with the vectors deandfthat form the diagonals of upper the 
half ofthe coefficient matrix. The program that sets up and solves the equations is 


function fDiff8 
% Finite difference method for the 4th-order， 


% inear boundary value problem in Example 8.8. 


XStart = 0; XStop = 0.5; % Range of integration ， 
Dn = 21; ”% Number of mesh polints . 
freq = 工 ; % Printout fredquency ， 

Ph = (CXStopPp - XStart)/ Cn-1) ; 

X = 1inspace(CXStart,XxStop,n) ”; 

[de fpD] = 三 DlifEEQS( 区 且 ， 卫 三 ; 

[Ques5 王 ] 三 IUdees5 (CQ Gy 和 7 
PrintSol(X,LUsol5(de,f,b),freq) 


function [de,f,b] = fDiffFqs(x,h,n) 
% Sets up the pentadiagonal coefficient matrix and the 
% constant Vector of the finite difference equations ， 


d = ones(n,1)*6; 
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e = ones(Cn-1,1)*(-4); 

在 = ones(Cn-2,1); 

b = zerosGCn,1); 

ac = 1 daC2) = 7 qdCn=1L) = 77 dpn7 = 3; 
e(1) = 0; f(G1I) = 0; bGCn) = 0.5*h”3; 


The lasttwo lines ofthe output are 


区 受 飞 YI 
4.7500e-001 2.1953e=003 
52.0000e-001 52.2344e-003 


串 | 一 。 | 一 5.2344 10 
X 和 55 PT7 JJ 二 一 0.5 “ 义 ET 


C27 
CIX2 








0 
X 一 0.5 1 8 





BEJJL 二 2J 十 Jo 
z-05 瑟 用? 


PLZL (5.1953 -- 2(5.2344) 十 5.1953) x 10-3 





五 了 0.0252 
了 区 
一 一 0.125 12 一 一 
万 了 
C27 
册 E6 吕 三 一 有 一 一 0.12512 PL 
0X2 | -05 


In comparison, the exact Solution yields 


忆 Z3 
| :05L 一 5.2083 x 本 


Mo5r 一 一 0.125 00 PL 


PROBLEM SET 8.2 





Problems 1-5 Usefirstcentraldifferenceapproximationstotransformtheboundary 
value problem shown into Simultaneous equations Ay = b. 

1. J “= (2 十 加] JO0) =0，]J (GD = 5. 

2. 内 三 yy 十 x2，y(0) = 0，y(GD) = 1. 

3 六 = 有 YIO=1 ID 

4. Jg9 = 夫 一 ny0) =0，y 0) =1，yG) = 0，y GD = 一 1. 

5. JJ = -9y 十 X，]y(0) = J (0) = 0，J 0) = yy = 0. 
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Problems 6-T70 Solve the given boundary value problem with the finite difference 
method using 72= 21. 
6. 国 ]) ”一 X)y，y() =1.5 y(C2) = 3. 
7. 国 ]" 十 2 十 = 0，jy(0) = 0，J( = 1. Exact solution is y = Xel-x. 
8. 国 X2]J 十 xy 十 y=0，y() = 0，J(2) = 0.638961. Exact solution isy = sin(ln 加. 
9. 国王 ysiny，y (0) = 0，J(r) = 1. 
10. 国 ]) ”十 2J(2xXYy 十 如 =0，]J(0) = 1/2，]J() = 一 2/9，Exact solution is = 
(2 十 X2)-1. 
1， 国 


Wo 
/ 0 


< 区 
AH L/2 1 上 L/4 zz 


The Simply supported beam consists of three Segments with the moments of 
inertia mn and 7 as shown.Auniformly distributed load of intensity ro acts over 
the middle segment. Modeling only the left half of the beam, we can show that 
the differential equation 



















































































d27 AM 
cx2 BT 
for the displacement vis 
尖 了 
二 in0 <X < 蕊 
C27 Z00 工 2 
02 一 45 万 > 2 
区 0 四 | x 发 了】 了 上 二 
2 诅 一 雪 光 专 寺 
全 | 五 了 4 4 2 
Introducing the dimensionless variables 
E 世 忆 10 7 后 
= 
changes the differential equation to 
二 in0 < 
一 一 过 二 过 
4 二 





08 1 l]\2] 1 1 
震 ( 5 开 二 


with the boundary conditions 


示 
JE-0 三 
时 GE E 一 1/2 
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]2， 


13. 


14. 
15. 


Usethefinite difference methodto determine the maximum displacement ofthe 
beam using7=21andy =1.5andcompare it with the exact solution 








The simply Supported, tapered beam has a circular cross section. A couple of 
magnitude Mo is appliedto theleftend ofthe beam. The differential equation for 
the displacement 7 is 


22 A4 Aho(1 一 2X/DD) 








CN2 FT BEB1d/ado)t 
where 
4a=a|1+( 和 -9 让 = 
Substituting 
郊 忆 10 4 
2 


changes the differential equation to 
02y 1 一 和 
2 
with the boundary conditions 








Jo 三 Ji-l1=0 
Solvetheproblem with the finite difference methodusing4 = 1.5and 刀 = 21;plot 
]J VS.E5.The exact Solution is 
G 二 235 一 35) 和 二 
6(1 半 3 王 司 ? 346 
国 Solve Example 8.4bythe finite difference method with 刀 = 21. 厅 71 大 Compute 
the end slopes from the second noncentral differences in Tables 5.3. 





国 Solve Prob. 20 in Problem Set 8.1 with the finite difference method. Use 刀 = 21. 
力 








区 列 Two-Point Boundary Value Problems 


16. 


下 


The simply supported beam of length ZL is resting on an elastic foundation of 
stiffnessKN/m2.The displacementvofthebeam duetotheuniformly distributed 
load of intensity xo N/m is given bythe solution ofthe boundary value problem 




















二 十 忆 三 Wo，Vlo 三 加 三 咱 x-z 三 县 二 
The nondimensional form of the problem is 
4 2 2 
5 十 yy 三 1， Jo 三 ， 加 = Js-1 三 人 本 一 0 
where 
s= 了 了 Jy= 二 多 和 
荆 ZI4 玉 了 7 


Solve this problem by the finite difference method with y = 105 and plot y vs.E. 


国 Solve Prob. 15 让 the ends of the beam are free and the load is confined to the 
middle half of the beam. Consider only the left half of the beam, in which case 
the nondimensional form ofthe problem is 


2 可 0in0< 二 <1/4 
lin1/4 <E < 1/2 


22 
2 


037y 


要 丰 037y 
5 08 


E=0 一 1/2 d83 


国 The general form of a linear second-order boundary value problem is 

















E 一 1/2 


]J “=TrOO 十 SCOJ 十 40OJ 
JJ 四 = 一 wory (dg =w 
J(O]=Bory 中 =B 


Write a program that solves this problem with the finite difference method for 
anyUser-Specified 7r(o, s(x) and tx. Testthe program by solving Prob. 8. 


IIATLAB Functions 


MATILAB has onlythe folowing function for solution ofboundary value pIoblems: 


sol = bvp4c(CaedEqs ,Qresidual,solinit) Uses a high-order finite difference 


method with an adaptive mesh to solve boundary value problems. The out- 
put sol is a S1Ucture (a MAILAB data type)j created by bvp4c. The first two 
input arguments are handles to the following user-supplied functions: 
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F = qdEqs(x,y) Specifies the first-order differential equations F(x, y) =y'. Both F 
and y are column vectors. 


z = tesidual(ya,yb) Specifies all the applicable the boundary residuals (da) 一 
oandy( 人 -Binacolumnvectorr, whereawiandpbiaretheprescribedbound- 
ary values. 


Thethirdinputargumentsolinitisastructurethatcontainsthexandy-valuesat 
thenodes ofthe initial mesh. This structure can be generated with MATILAB'S function 


了 六 D 六 计 才 ; 


solinit = bvpinit(xinit,GQyguess) where xinit is a vector containing the X- 
coordinates ofthenodes; yguess(x) is auserI-Suppliedfunction that returns a 
column vector containing the trial solutions for the components of V. 


The numerical solution at user-defined mesh points can be extracted from the 
Structure sol with the MATITLAB function deval: 


Yy = deval(sol,xmesh) where xmesh is an alITay containing the X-coordinates of 
the mesh points. The function returns a matrix with the ;th Tow containing the 
values ofy atthe mesh points. 


The folowing program ilustrates the use of the above functions in solving 
Example 8.1: 


function shoot2_mat]ab 
% Solution of Example 8.1 with MATLAB 's function bvp4c . 


XiInit = 1Linspace( 人 0,2,11) ”; 

Solinit = bvpinit(xjinit,Qyguess) ; 

SolL = bvp4c(CadEqs ,Qresidual ,solLinit) ; 
Yy = deval(solL ,Xinit)7 ”; 


DPIzintSolL(Cxinit ,7y, 工 ) % This Is our own funec . 


function EF = qEqs(x,y) % DifferentiIal eqs . 
上 -三 【[Y(27)7 385Y(CLTD)YYCG227 3 


function YY = zesidual(ya,yb) % Boundary tfresliduals . 
z = [ya(1)， yb(CL) = 工 ] ; 


function Yinit = YygueSss(X) % _ Initial guessses fo 


工交 了 本 05 % YL and Y2 . 


9 


9.1 





9ymmetric Matrix Eigenvalue Problems 


Find 和 for which nontrivial solutions ofAx = 和 X exXist 


Introduction 


The stda1d jprm ofthe matrix eigenvalue problem is 
AX 一 和 X (9.1) 


whereAis a given7 xmatrix. The problem is to fnd the scalar 和 and the vectoT X. 
Rewriting Eq. (9.1) in the form 


(A--XDx=0 .9 


it becomes apparentthat we are dealing with a system of 2 homogeneous equations. 
An obvious solution is the trivial oneXx= 0.Anontrivial solution can exist only 过 the 
determinant ofthe coefhicient matrix vanishes; that is, 让 


IAA 一 AI =0 (9.3) 


Expansion of the determinant leads to the polynomial equation known as the 
C1a1acteTzstic eqUQ1io7 


0 十 XI 十 十 OA 二 al=0 


WwWhich has the roots Xi 一 1,2,...,1 caled the elgemyalues of the matrix A. The 
Solutions xi of (A 一 和 iDX= 0areknown as the elge12vectors. 
As an example, consider the matrix 


1 一 1 0 
A=|-1 2 -=! (al 
0 一 1 1 


9.1 Introduction 


The characteristic equation is 


人 = 三 | -1 2 一 六 1 |=-3+4X2 一)3=0 (b) 
0 -1 1- 入 








The roots of this equation are 和 1 = 0, 和 2 = 1 和 3 = 3. TIo compute the eigenvector 
Corresponding the 和 3, we Substitute 和 人 入 = 和 3 into Eq. (9.2), obtaining 





一 2 一 0 2 0 
一 一】 一 1 Xe | 三 |0 (C) 
0 ， 一】 -一双 3 0 


We know that the determinant of the coeffGcient matrix is zero, so that the equations 
arenot linearly independent. Therefore, we can assign an arbitrary value to any one 
componentofxand use two ofthe equations to compute the other two components. 
Choosingx = lthefirstequation ofEq.(c)yieldsxo = -2andfromthethirdequation 
we get xz = 1. Thus the eigenvector associated with 和 3 is 


1 
X3s 一 | 一 2 
〖 
The other two eigenvectors 
1 
X2 一 0 Xi 三 
一 


can be obtained in the same manner. 
It is sometimes convenient to display the eigenvectors as columns of a matrix 又 . 
FEor the problem at hand, this matrix is 


1 1 1 
两 xs x| = 1 0 -2 
1 -1 1 


Itis clearfrom the above examplethatthemagnitude ofan eigenvectoris indeter- 
minate; onlyits direction can becomputedfrom Eq. (9.2). Itis customaryto 701717C1zze 
the eigenvectors by assigning a unit magnitude to each vector. Thus the normalized 
eigenvectors in ouUr example are 


1/V3 1/V2 1/V6 
X= |1/V3 0 -2/V6 
1/V3 -1/V2 1/V6 


Throughout this chapter we assume that the eigenvectors are normalized. 
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9.2 


Here are Some Useful properties of eigenvalues and eigenvectors, given without 
prIoof: 


。 All eigenvalues of a symmetric matrix are Teal. 

。 All eigenvalues of a symmetric, positive-definite matrix are TIeal and positive. 
。 The eigenvectors of a symmetric matrix are orthonormal; that is， XIX = 工 

。 Ifthe eigenvalues ofA are Xi, then the eigenvalues ofA-l are )7 1. 


Eigenvalue problems that originate from physical problems often end up with 
asSymmetric A. This is fortunate, because Symmetric eigenvalue problems are much 
easierto solvethantheirnonsymmetriccounterparts.Inthis chapterwelargelyrestrict 
our discussion to eigenvalues and eigenvectors of symmetric matrices. 

Common Sources of eigenvalue problems are the analysis of Vibrations and sta- 
bijlity These problems often have the following characteristics: 


。 The matrices are large and sparse (e.g., have abanded structure). 
。 Weneed to know only the eigenvalues; 让 eigenvectors are required only a few of 
them are of interest. 


Ausefuleigenvalue solvermustbeabletonutilizethese characteristics to minimize 
the computations. In particular it should be flexible enough to compute only what 
weneed and no more. 


Jacobi Method 
Similarity Transformation and Diagonalization 
Consider the standard matrix eigenvalue problem 
AX 一 人 X (9.4) 


whereAis symmetric. Let us now apply the transformation 


一 Pxe (9.5) 


wherePisanonsingularmatrix.SubstitutingEq. (9.5) into Eq. (9.4) andpremultiplying 
each side byP-l, we get 


P-1APx* 一 和 P-L1Pxr 
OLT 


AS 一 和 (9.6) 
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where A* = P-1AP. Because 和 was untouched by the transformation, the eigenval- 
ues of A are also the eigenvalues ofA*. Matrices that have the same eigenvalues are 
deemed to be Si11171Cj and the transformation between them is called a SI77271C77z/ 
17C11s1o7720170717. 

Similarity transformations are frequently used to change an eigenvalue problem 
to a form that is easier to solve. Suppose that we managed by some means to find aP 
that diagonalizes A", so that Eqs. (9.6) are 


4 0 0 寻 0 
0 4 久 - 和 0 从 0 
0 0 4 一 | 丰 0 


The solution ofthese equations is 


和 = 作乱 = 和 (9.7) 
1 0 0 
0 1 0 
XI 一 22 一 | . ZX 一 
0 0 1 
OFT 
| 浊 了 汉 | SS 


According to Eq. (9.5) the eigenvector matrix ofA is 
X=PX-* =PI= 了 (9.8) 
Hence the transformation matrixP is the eigenvector matrix ofA and the eigenvalues 


ofA are the diagonal terms of A*. 


Jacobi Rotation 


Aspecial transformation is the plane rotation 


X 一 Rx (9.9) 
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where 
于 也 
1 0 0 0000 0 
0 1 0 0.000 0 
00 cc 00058500|K 
R 00 0 100.0 0 (9.10) 
00 0 01.00 0 
00 -300c0 02 
00 0 000 .1.0 
00 0 0000 1 


is called the /Ccopi rotatio7m 102017X. Note that R is an identity matrix modified by the 
termas C = cos0 ands= Sin0 appearing at the intersections of columns/rows Kand 
已 where b is the rotation angle. The rotation matrix has the useful property of being 
017 态 ogo101 or UV11101 meaning that 


R-l = 有 7 (9.11) 


One consequence of orthogonality is that the transformation in Eq. (9.9) has the 
essential characteristic of a rotation: it preserves the magnitude of the vector; that is， 
|x| = | 天 | 

The Similarity transformation corresponding to the plane rotation in Eq. (9.9) is 


A* =R-IAR = RIAR (9.12) 


The matrixz A* not only has the same eigenvalues as the original matrixA, but due to 
orthogonality of Riit is also symmetric. The transformation in Eq. (9.12) changes only 
the rows/columns andt ofA. The formulas for these changes are 


4 入 = c24 了 十 34oe 一 2csAke 
4ee = c2 4 十 S2 4 十 2cs4ke 

和 = 4 你 = (2 一 S4k+csC4k- 40 (9.13) 
4 一 4 一 CA 一 SA4ci，1 关 万 了 二 - 


46 =4c=Cc4ei+S4u， 71 关 乒 工 天 


Jacobi Diagonalization 


TheanglegintheJacobirotationmatrixzcanbechosensothat 4x, = 4 = 0.This sug- 
gests thefollowingidea: whynot diagonalizeAbyloopingthrough all the offt-diagonal 
termsandeliminatethem onebyone?Thisis exactlywhatJacobidiagonalization does. 
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However there is a major snag 一 the transformation that annihilates an offt-diagonal 
term also undoes Some of the previously created zeroes. Fortunately it turns out that 
the offt-diagonal terms thatreappear will be smaller than before. Thus Jacobi method 
is an iterativeprocedurethatrepeatedlyapplies Jacobirotations until the offt-diagonal 
terms have Virtually vanished. The fnal transformation matrix P is the accumulation 
ofindividual rotations Ri: 


了 王 Ri.R2.Ras …， (9.14) 


The columns ofP finish up being the eigenvectors ofA and the diagonal elements of 
A* = PTIAP become the eigenvectors. 
Let us now look at the details of a Jacobi rotation. From Eq. (9.13) we see that 
入 = 一 0 这 
K 


(c 一 sS4k +csC4k 一 4 =0 (a 


Using the trigonometric identities c2 -3 = cos20 and cs = (1/2) sin 20, we obtain 
位 om Eq. (a) 


24k 
tan 20 = 一 一 一 一 (b) 
4 一 4ee 
which couldbe solvedforo,followedby computation ofc = cosg ands = Sin0.How- 
eveb the procedure described below leads to a better algorithm.20 


Introducing the notation 





4 一 4ee 
一 cot20 一 9.15 
力 = CO 2 (9.15) 
and utilizing the trigonometric identity 
2 
tan 20 = 一 一 一 一 
(一 妇 ) 


wherezt= tanb, we can write Eq. (b) as 
帮 十 201 一 1 一 0 


which has the roots 





人 


It has been found that the root | 媳 < 1 which corresponds to |0| < 45”, leads to the 
more stabletransformation. Therefore, we choosetheplus sign 让 > 0andtheminus 


20 The procedure is adapted from W.H. Press ef C1.，NU11IeTicaL Recipes 胡 Forta12 2nd ed. (1992)， 
Cambridge University Press. 
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sign 让 < 0, which is equivalent to using 


1 一 Sgn(0) (- | 的 十 V 9 十 


To forestall excessiveroundofferrority islarge,wemultiplyboth sides ofthe equation 
bylbl 上 +V%2 二 1andsolveforb which yields 


1 二 Sgn( 人 ) 
lg 十 V 入 十 1 
In the case ofvery large we Should replace Eq. (9.16a) by the approximation 
三 
2 
to prevent overflow in the computation of %2. Having computed we can use the 
trigonometric relationship tan0g = Sinb/cosg =V1-cos20/cosoto obtain 


1 
1 十 经 


(9.16a) 


(9.16b) 





E 三 SS 一 区 (9.17) 


Wenowimprove the computational properties ofthe transformation formulas in 
Eqs. (9.13). Solving Eq. (a) for 4vo, we obtain 


C2 2 





4ee = 4 卫 十 4ke (C) 


Replacing all occurrences of 4 byEq. (c) and simplifying, we can write the transfor- 
mation formulas in Eqs. (9.13) as 


4 一 4 一 1L4k 
4e = 4ce 十 14ke 
尺 =4xk=0 (9.18) 
训 二 多 =4 一 Si+Tr4a， 矿工 关 《 
4i=4e = 人 4i+SL4a 一 rho 7 太守 天 4 
where 


SS 
一 
1 十 C 





[9.19) 


The introduction of r allowed us to express each formula in the form (original 
value) + (changej, which is helpful in reducing the roundoff error. 

At the start of Jacobis diagonalization process the transformation matrix P is 
initialized to the identity matrix. Each Jacobi rotation changes this matrix from P 
to P” = PR. The corresponding changes in the elements of P can be shown to be 
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(only the columns Kandt are affected) 


有 二 有 一 SCPe 十 rr 忆 昌 (9.20) 


世 


PP = Poe+SRK 一 zPoO 


We still have to decide the order in which the oft-diagonal elements ofA are to be 
eliminated. Jacobis original idea was to attack the largest element since this results 
in fewest number of rotations. The problem here is that A has to be searched for 
the largest element after every Iotation，which is a time-consuming process. If the 
matrix is large, it is faster to sweep through it by rows or columns and annihilate 
eveIyelementabove some threshold value. In the next sweep the threshold is lowered 
and the process repeated. We adopt Jacobis original scheme because of its simpler 
imnplementation. 

Insummary theJacobidiagonalization procedure, which uses onlytheupperhalf 
ofthe matrix, is 


Find the largest (absolute value) offt-diagonal element 4ke in the upper half of A. 
Compute 四 ,六 cands from Eqs. (9.15)-(9.17). 

Compute r from Eq. (9.19). 

Modify the elements in the upperhalf ofA according to Eqs. (9.18). 

Update the transformation matrixP using Eqs. (9.20). 


5 


Repeat the procedure until the 4ke < s, where s is the error tolerance. 
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The function jacobi computes all eigenvalues Xi and eigenvectors Xi ofa symmetric， 
1x7matrixAbytheJacobimethod.The algorithm works exclusively with the upper 
triangular part ofA, which is destroyed in the process. The principal diagonal ofA is 
Ieplacedbythe eigenvalues, and the columns ofthe transformation matrixP become 
the normalized eigenvectors. 


function [evVals,eVvVecs] = JacobIi(CA,tol) 
% Jacobi method for computing eligenvalues and 
% eligenvectors of a Symmetzrlic matrIXx A. 
% USAGE: [eVals,evVecs] = JacobIi(CA,tol) 


% tol = error tolerance (default is 1.0e-9) . 


If narglin < 2;j tol = 1.0e-9; end 
nn = Size(A,1); 


maxXRot = 5x(n 2); % ILimit PPnumbezr of rotations 
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P = eye(Cn) ; % ImnitIalize YotatIion matITIX 
for 工 = 1:maxRot % Begin Jacob fotatIions 
[Amax,k, 工 ] = maxElem(CA) ; 
IfE Amax < tol; 
eVals = diag(A); eVecs = 了 P; 
TetuTrDn 
emnd 
[A,P] = Totate(A,P,K, 工 ) ; 
end 


error( Too many Jacob1I rotations ') 


function [Amax,K, 工 ] = maxElem(CA) 
% Finds Amax = A(CK,L) (largest off-dqiag. elem. of A) . 
nn = Size(A,1) ; 
AmaXx = 0 
for 工 = 工 :mn-I 
for j = +1:nm 
If abs(A(CI,J)) >= AmaX 
Amax = abs(CACGI,J)); 
下 到 了 
end 
end 


end 


function [A,P] = Fotate(A,P,K, 工 ) 
% Zeros A(Ck,L) by a Jacobli rotation and updates 
% transformation matrlIXx 了 . 
D = Size(A,1) ; 
diff = AGEL,L) - ACK,K) ; 
If abs(CACKkK,L)) < abs(diff)*1.0e-36 
七 = AGK, 工 ); 
else 
phi = diff/(C2*ACGK, 工 ) 7) ; 
廿 = 1/Cabs(Cphi) + sqrtCphi 2 + 1)) 
If phi<0;i 芋 = -ti endi 
end 
@ 研 工 /SGDTEt( 上 2 二 二 二 Go 
tau = S/(1L + c) 
temp = ACK,L); ACK,L) = 0 
A(CK,K) = ACK,K) - tx*temp 
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A(G(L,L) = AGL,L) + tx*temp ; 

for 工 = 工 :K- 工 % For 工 < 
temp = A(CI,K) ; 
A(I,K) = temp -Sx*(A(GI,L) + tauxtemp) ; 
ACTI,L) = A(GI,L) + Sx*(Ctemp - 廿 auxA(CI, 工 ) ) ; 


emnd 

for 工 = KK+1: 工 - 工 % For K< 工 <L 
temp = AGCK, 工 ) ; 
A(CK,I) = temp - Sr*(ACGTI,L) + tauxA(CK, 工 ) ) ; 
A(CI,L) = ACTI,L) + S*(Ctemp - tauxA(CI, 工 ) ) ; 

end 

for 工 = IL+1:n % For 工 > 工 


temp = ACK, 工 ) ; 
A(CK,I) = temp - Sr*(ACGL,I) + tauxtemp ) ; 
A(L,I) = A(L,I) + S*(Ctemp - tauxA(CL,I) ) ; 
emnd 
fom = 工 :了 % Update transformation matzIX 
temp = 了 PCI,K) ; 
PCI,Kk) = temp - S*(PCGI,L) + taux*P(CI,K) ) ; 
PCI,L) = PGI,L) + Sx*(Ctemp - taux*P(CI, 工 ) ) ; 


emnd 


国 SOTtE1Igen 


Theeigenvalues/eigenvectorsreturnedbyjacobiarenotordered.IThefunctionlisted 
below can be used to sort the results into ascending order of eigenvalues. 


function [evVals,eVvVecs] = SortEigen(CeVals,eVecs) 

% Sorts eligenvalues & eligenvectors into ascendjing 
% order of eligenvalues . 

% USAGE: [eVals,evVecs] = SortEigen(CeVals ,eVecs) 


na = lengthCeVals) ; 
for 二 = 1:m-I 
Index = 工 ;) val = eVals(I) ; 
for j = +1:mn 
If eVals(Jj) < val 
Index = jj val = eVals(]J) ; 
end 


end 


攻 到 symmetric Matrix Eigenvalue Problems 


If indeX ”= 工 
eVals 


SWapRows(eVals,I, index) ; 


eVecsS 


SwWapCols(CeVvVecs ,IIindex) ; 
end 


end 


Transformation to Standard Form 
Physical problems often give rise to eigenvalue problems of the form 
Ax 一 入 BX (9.21) 


whereAandB aresymmetric7 x matrices.WeassumethatBis alsopositive definite. 
Such problems mustbetransformed into the standard form before they can be solved 
by Jacobi diagonalization. 

As B is symmetric and positive definite, we can apply Choleskis decomposition 
B=LL7 whereLis a lower-triangular matrix (See Art. 2.3). Then we introduce the 
transformation 


元 三 全 汪 2 (9.22) 
Substituting into Eq. (9.21), we get 
AL-)7z=XLLTGL-D7z 
Premnultiplying both sides byL-lresults in 
L-IAL- 7z= 和 LILLITGCL-D7z 
BecauseL- 志 =LIC-0)7 =Lthelastequation reduces to the standard form 
Hz 一 入 Z (9.23) 

where 

了 = EL-IAC- (9.24) 


An importantproperty ofthis transformation is that it doesnot destroy the symmetry 
of the matrix; ie a symmetricAresults in a symmetric 开 . 

Here is the general procedure for Solving eigenvalue problems of the form 
Ax 一 入 BX: 


1. Use Choleskis decomposition B = LL7 to compnute 工 . 

2 ComputeL-l (atriangular matrix can be inverted with relatively small computa- 
tional eftortb). 

3. Compnute H from Eq. (9.24). 


9.2 Jacobi Method 


Solve the standard eigenvalue problem Hz = 和 z (e.g., Using the Jacobimethod). 
5. Recover the eigenvectors of the original problem from Eq. (9.22): X 王 (L-D)Tz， 
Note that the eigenvalues were untouched by the transformation. 


An important Special case is where B is a diagonal matrix: 


6 0 5 0 
0 8b，.… 0 
B=|.， . (9.25) 
0 0 B， 
Here 
1 0 0 号 0 0 
0 ph 5 加 0 几 
ER LI =| ， 加 (9.26al 
人 太 0 0 312 
and 
功 = LAj(26N (9.26b) 
国 Ss 丁 IFEOTm 


Given the matricesAand B, the function stdFormreturns H and the transformation 
matrixT= (L-7.The inversion ofL is carried out by the subfunction invert (the 
triangular shape ofL allows this to be done byback substitution). 


function [H,I] = stdForm(A,B) 

% Transforms A*X = ambdqax*Bx*X to Hx*Zz = ambdqa*Z 

% and computes transformation matrix Tin X= ITx*z， 
% USAGE: [H,IT] = stdForm(A,B) 


nm = Size(A,1) ; 
工 = choleskli(CB); Linv = Invert(I) ; 
末 - 三 : 王 王 而 于 尖 区 太 光 再 王 而 站 天王 荆 7 


下 ime 才 斌 DO 而 开工 六 闷 三 工 和 et 
% InvertSs Lower triangular matrliXx 工 . 
玫 三 SEEG(CE 7) 
于 GO 基本 三 十 = 寺 
L(j,Jj) = 1L/LCJ ,JJ) ; 
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for 工 = J+1:nm 
L(Ci,Jj) = -dot(LCI,J:I-1L)，LILCJ:I-1L,J)MA 人 ECG,I)D) 
emnd 
end 
二 和 和 三 / 人 《三 朴 放 了 7 开 二 和 六 二 王 ， 





EXAMPLE 9.1 
40 MPa 
30 MPa 30 MPa 
由 MPa 
60 MPa 











The stress matrix (tensor) Corresponding to the state of stress Showmn is 


80 30 0 
S=|130 40 0|MPa 
0 0 60 


(eachrow ofthematrix consists ofthe three stress components actingon acoordinate 
plane). It can be shown that the eigenvalues of S are the PT7impzcipal1 stesses and the 
eigenvectors are normal to the PT7zmzcipal Pa1es. (1) Determine the principal stresses 
by diagonalizing S with a Jacobi rotation and (2) compute the eigenvectors. 


solution of Part (1) Io eliminate 9 we must apply a rotation in the 1-2 plane. With 
人 上 = 一 1and 上 一 2Eq.(9.15) is 


5 一 35 80 - 40 2 
2S9> 20) 3 





力 一 
Equation (9.16a) then yields 
Sgn( 人 ) 


一 | 
三 二 一 
Il 加 上 +V92 二 1 2/3+V(2/3)2 十 1 


According to Eqs. (9.18), the changes in S due to the rotation are 





0.53518 


ST = S11 一 19i2 = 80 -- (-0.53518) (30) = 96.055 MPa 





S3 一 9” 十 ft9l， 一 40 十 (一 0.53518) (30) = 23.945 MPa 
912 一 921 =0 
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Hence the diagonalized stress matrix is 


96.055 0 0 
S = 0 23.945 0 
0 0 60 


where the diagonal termas are the principal stresses. 


solution of Part (2) To compnute the eigenvectors, we start with Eqs. (9.17) and (9.19)， 
which yield 


1 
一 一 
VI 十 妈 V1T+ (0.53518)2 


3 一 大 = (一 0.53518) (0.88168) = 一 0.47186 
有 一 0.47186 
“一 1 一 IT088168 一 
We obtain the changes in the transformation matrix P from Eqs. (9.20). Because P is 
initialized to the identity matrix (有 =1and 忆 =07 和 关 Jthefirstequation gives us 


一 0.88168 











0.25077 


DPI = 万 1 一 SP 二 rz 

二 1- (-0.47186) [0 十 (-0.25077) (H)] = 0.88167 
Pi = 书 1 一 SP 十 rz 忆 1) 

一 0-(-0.47186) [1 十 (-0.25077) (0)] = 0.47186 


Similarly the second edquation of Eqs. (9.20) yields 
疡 >” = 一 0.47186 疡 5” = 0.88167 


The third row and column ofP are not affected by the transformation. Thus 


0.88167 -0.47186 0 
PE 一 |0.47186 0.88167 0 
0 和 工 


The columns of P* are the eigenvectors of S. 


EXAMPLE 9.2 
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() Show that the analysis of the electric circuit shown leads to a matrix eigenvalue 
piIioblem. (2) Determine the circular frequencies and the relative amplitudes of the 
CUITrents， 


solution of Part (1) Kirchoff's equations for the three loops are 




















十 人 _0 
二 人 下 到 二 _0 
二 =0 
Differentiating and substituting dqk/dt = 加 we get 
二 而 
六 十 二 玫 一 为 一 
疡 十 2 为 一 R 


These equations admit the solution 
有 大 太一 Sinotf 


where w is the circular frequency of oscillation (measured in rad/sS) and zx are the 
relative amplitudes of the currents. Substitution into Kirchoffs equations yields 
Au = 入 Bu (Sin wof cancels oub, where 


ly3 =13 0 1 0 0 
A=|-1/3 4/3 -=1 B=|0 1 0 入 一 工 Cw? 
0 -1 2 0 0 2 


which represents an eigenvalue problem of the nonstandard form. 


solution of Part (2) SinceBis adiagonalmatrix, we canreadilytransformtheproblem 
into the standard form Hz = 和 z. From Eq. (9.26a) we get 


1 0 0 
LI:=|Oil 0 
0 0 1/V2 
and Eq. (9.26b) yields 
1/3 -1/3 0 


了 = | -1/3 4/3 -1/V2 
0 -1/V2 1 
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The eigenvalues and eigenvectors of H can now be obtained with the Jacobi method. 
Skipping the details, we obtain the following results: 


人 1 一 0.14779 人 2 一 0.58235 人 3 一 1.93653 


0.81027 0.56274 0.16370 
Z1 一 | 0.45102 Z2 一 | 一 0.42040 Z3 一 | 一 0.78730 
0.37423 一 0.71176 0.59444 


The eigenvectors of the original problem are recovered from Eq. (9.22): 允 一 (LT7z，， 


Which yieldqs 
0.81027 0.56274 0.16370 
ul 三 | 0.45102 Uu2 = | 一 0.42040 us 三 | 一 0.78730 
0.26462 一 0.50329 0.42033 


These vectors should now be normalized (each zi was normalized, but the transfor- 
mation to ui does not preserve the magnitudes of vectors). The circular frequencies 


are wi 一 Xi/ (ELC), sothat 
0.3844 0.7631 1.3916 
7 蕉 一 co 一 2 
”，Vv 区 2 人 











EXAMPLE 9.3 








Thepropped cantileverbeam carries a compressive axial load P.Thelateral displace- 
ment V(x) ofthe beam can be shown to satisfy the differential equation 


及 
的 了 二 
Z ”十 瑟 了 0 (al 
where ETis the bending rigidity The boundary conditions are 
0O=zwO=0 xD=wOD=0 (D) 


() Show that displacement analysis of the beam results in a matrix eigenvalue 
pIoblem 这 the derivatives are approximated by finite differences. (2) Use the 
Jacobi method to compute the lowest three buckling loads and the corresponding 
eigenvectors， 


solution of Part (1) We divide the beam into 7 十 1 segments of length 世 /(2 十 了 
each as Shown and enforce the differential equation at nodes 1] to 1. Replacing the 
derivatives of wx in Eq. (a] by central finite differences of O(12) at the interior nodes 
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(nodes l to 站, we obtain 


夏 -2 一 41 十 6 丰 一 4U+1 十 其 +2 








及 4 
一 大 -1 十 2 砧 一 KEHL  ， 
三 > “全 由 25 
忆 了 172 


After multiplication by j4, the equations become 
LI 一 4U0 十 6V1 一 472 十 Za 三 入 (一 20 十 2U1 一 ZU2) 
10 一 4V1 十 612 一 413 十 14 二 入 (一 UI 十 272 一 ZU3) 


(C) 


Zip-3 一 420-2 相遇 6Z-1 人 4zi 十 Un+1l 一 入 (一 Zi-2 可 用 22pp-1 ZI) 





Zr-2 一 42-1 光 | 6z 一 420r+1 十 Upr+2 一 入 ( ZI-1 21j Zi+1) 


where 
三 忆 122 _ 三 工 ? 
ET (2 二 1D2ET 
The displacements zZ_1 0 ZUx+l and zi+2 can be eliminated by using the prescribed 


boundary conditions. Referring to Table 8.1 we obtain the finite difference appIoxi- 
mations to the boundary conditions in Eqs. (b): 





MUM0 王 0  ， 1= 一 外 Zn 三 0 Wi+2 三 轴 


Substitution into Eqs. (c) yields the matrix eigenvalue problem Ax = 和 BX, where 


5 一 4 1 0 0 …， 0 
一 4 6 一 4 1 0 …， 0 
1 一 4 6 一 4 1 0 
A 一 
0 1 一 4 6 一 4 1 
0 0 1 一 4 6 一 4 
0 0 0 1 一 4 7 
2 一 1 0 0 0 0 
一 | 2 一] 0 0 0 
0 三 1 2 三] 0 0 
也 一 欠 
0 0 一 1 忆 一 工 0 
0 0 0 一 1 2 一 工 


343 | 9.2 Jacobi Method 


solution of Part (2) Theproblem with theJacobimethodisthatitinsistsonfinding cZ 
the eigenvalues and eigenvectors. It is also incapable ofexploiting banded structures 
of matrices. Thus the program listed below does much more work than necessary for 
the problem at hand. More effGicient methods of solution will be introduced later in 
this chapter. 


% ExXample 9.3 (JacobI method) 
mn = 10; % Number of interior nodes . 
A = zeros(n); B = Zeros( 人 Cn) ; % Start constructing A and B. 
fom 工 = 工 :了 
ACTI,I) = 6; BCGI,I) = 2; 
end 
A(1,1) = 5; AGCn,n) = 7; 
fomr 工 = 1 工 :mn-I 
A(CI,I+I) -4; ACi+1,I) 
B(CI,i+Ll) = -1; BCi+lL,I) 


[| 
卢 ”小 


emnd 
for 工 = 1:n-2 
A(CI,I+2) = LI; A(Ci+2,I) = 1 工 ; 


emnd 

[H,I] = stdForm(A,B) ; % Convert to std. form . 
[evVals,Z] = JacobICH) ; % Solve by JacobiI method . 

= 工 xZ; % Eigenvectors of orig， prohb ， 
fom 二 = 工 :了 % Normalize egenvectors . 


xxMag = sqrt(Cdot(CX(C:,I),XC:，,I)D)); 
XC:,I) = X(C:,I)V/XMag ; 


emnd 

[evVals,X] = SortEligen(CeVals,X); % Sort in ascending order . 
edIgenvalues = eVals(1:3)” % EXtract 3 smallest 
edIgenvectors = XC:,1:3) % eligenvalues & vectors . 


Running the program resulted in the following outpnut: 


>> elgenvalues = 
0.1641 0.4720 0.9022 
edIgenvectors = 
0.1641 -0.1848 0.3070 
0.3062 -0.2682 0.3640 
0.4079 -0.1968 0.1467 
0.4574 0.0099 =-0.1219 
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0.45195 0.2685 ss0.51725 
0.3961 0.4711 0.0677 
0-3052 05536 工 0.4089 
0.1986 0.4471 0.5704 
0.0988 0.2602 0.4334 
0.0270 0.0778 0.1486 


The first three mode shapes, which represent the relative displacements of the 
buckled beam, are plotted below (we appended the zero end displacements to the 
eigenvectors before plotting the points). 


0.6 





0.4 上 











The bucklingloads are given by 书 = (7 十 看” 和 Xi BT/L2.Thus 





(11)2 (0.1641) BT 殖 7 
(11)2 (0.4720)] ET 已 
11)2 (0.9022) BT 殖 7 

人 人 一 109.2 
区 2 工 2 


The analytical values are 局 = 20.19BFT/Z2, 忆 = 59.68BT/72 and 启 =118.9B7/72.I 
can be seen that the error introduced by the finite element appIoximation increases 
with the mode number (the error in Pis largerthan in 已 ). Of course, the accuracy 
of the fnite difference model can be imnproved by using larger 1 but beyond 刀 = 20 
the cost of computation with the Jacobi method becomes rather high. 


Inverse Power and Power Methods 
Inverse Power Method 


The inverse power method is a simple iterative procedure for fnding the smallest 
eigenvalue 和 1 and the corresponding eigenvector xl of 


AX 一 人 X (9.27) 
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The method works like this: 


1. Letvbe an approximation to xl (arandom vector ofunit magnitude will do). 
2.， Solve 


Az =V (9.28) 


for the vector z. 
3. Compnute |z|. 
4.， Letv=zZ/Izl andrepeat steps 2-4 until the change invis negligible. 


At the conclusion of the procedure, |IZ| = 士 1/ 和 1 andv = Xl. The sign of 和 il is de- 
termined as follows: 让 z changes sign between Successive iterations, 和 1 is negative; 
otherwise, 和 1 is positive. 

Let Us now investigate why the method works. Since the eigenvectors Xi of 
Eq. (9.27) are orthonormal theycanbeusedasthebasis for any7-dimensional vector. 
Thusvandzadmitthe unique representations 


了 玫 也 
V 一 六 万 允 也 一 >》， Xi (al 
这] 记 1 


Notethatv andz arenotthe elements ofvandz, butthe components with respect 
to the eigenvectors Xi. Substitution into Eq. (9.28) yields 


用 也 
A》 zi E 太 Xi 一 0 
1 | 
But Axi 一 和 ijXi, So that 


用 
六 (Mi 一切) 一 0 
| 





Hence 
也 一 
全 和 
It follows from Eq. (a) that 
甩 旋 1 也 入 1 
也 一 Xi 一 姑 允 5 
号 人 1 人生 
| (9.29) 
二 X 一 和 X 一 Xa 十 …. 
克 1XI 2 7 2 3 3 


SincelX1/il < 1 工 G 关 1]),weobservethatthe coefficientofxl has becomemorepromi- 
nentinzthan it was in vi hencezis abetter appIoximation to xl. This completes the 
first iterative cycle. 
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In subsequent cycles we setv = Z/Iz| and repeat the process. Each iteration will 
increase the dominance ofthe firstterm in Eq. (9.29) so that the process converges to 
有 


也 三 一 册 区 I 三 一 1 
和 1 和 1 





(atthis stagev 一 Xl, Sothat 刀 = 岂 = 岂 = 一 0). 
The inverse power method also works with the nonstandard eigenvalue problem 





Ax = 入 Bx (9.30) 
prIovided that Eq. (9.28) is replaced by 
Az = Bv (9.31) 


Thealternative is, of course, to transform the problem to standard form before apply- 
ingthe power method. 


Eigenvalue Shifting 


By inspection of Eq. (9.29) we see that the rate of convergence is determined by the 
Strength ofthe inequality | 和 X1/Xz| < 1 (the second term in the equation). 开 | 和 >| is well 
Separatedfrom |Xil,theinequalityis strongandthe convergenceisIrapid.Onthe other 
hand, close prOoximity of these two eigenvalues results in very Slow convergence. 

The rate of convergence can be improved by a technique called eige7zvC1ze 
S1 太 1128. 下 we let 


入 一 人 十 $ (9.32) 


where S is a predetermined “shiftb”the eigenvalue problem in Eq. (9.27) is trans- 


formed to 
Ax = (人 十 3)X 
OT 
A 一 <X (9.33) 
where 
人 一 A 一 SI (9.34) 


Solving the transformed problem in Eq. (9.33) by the inverse power method yields 和》 
andxl, where 和 jis the smallest eigenvalue ofA*. The corresponding eigenvalue ofthe 
original problem, 入 = 人 十 Sis thusthe elge727C1xe closesf 10 $. 

Eigenvalue shifting has two applications. An obvious one is the determination of 
the eigenvalue closestto a certain value s. For exzample, 让 the working speed of a shaft 
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is s rpm it is imperative to ensure that there are no natural frequencies (which are 
Ielated to the eigenvalues) close to that Speed. 

Eigenvalue shiftingis also be used to speed up convergence.Suppose that we are 
computing the smallest eigenvalue 和 li of the matrixA. The idea is to introduce a shift 
s that makes Xi/ as Small as possible. Since 人 1 = 人 1 一 S%, we Should choose s 宕 和 1 
($ = 和 1 Should be avoided to prevent division by zero). Of course, this method works 
only 直 we have aprior estimate of 入 1. 

The inversepowermethod with eigenvalue shiftingis aparticularlypowerfultool 
for finding eigenvectors 计 the eigenvalues are known. By shifting very close to an 
eigenvalue, the corresponding eigenvector can be computed in one or two iterations. 


Power Method 


The power method converges to the eigenvalue /rtpestjomz zero and the associated 
eigenvector, It is very simijlar to the inverse power method; the only difference be- 
tween the two methods is the interchange ofvandzin Eq. (9.28). The outline of the 
piIocedure is: 


1. Letvbe an approximation to xn (arandom vector ofunit magnitude will do). 
2. Compute the vector 


Z 一 Av (9.35) 


3. Compnute |z|. 
4. Letv=zZ/Izl andrepeat steps 2-4until the change invis negligible. 


At the conclusion of the procedure, |Iz| = 士 Xx andv 三 (the Sign of 和 is deter- 
mined in the same way as in the inverse power method). 


国 nnVZPoweTL 


GiventhematrixzAandthescalars,thefunction invPowerreturns theeigenvalue ofA 
closesttosandthe corresponding eigenvector ThematrixA* =A 一 SIis decomposed 
as SOon as it is formed, so that only the solution phase (forward and back substitu- 
tion) is needed in the iterative loop. 太 Ais banded, the efficiency of the program can 
be improved by replacing LUdec and LUsol by functions that Specialize in banded 
matrices 一 See Example 9.6. The program line thatformsA* mustalso bemodified to 
be compatible with the storage scheme used for A. 


function [evVal,eVec] = InvPowezr(A,s,maxIter ,tol) 
% _ Inverse power mehod for finding the eligenvalue of A 


% closest to S & the correstponding eligenvector ， 
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% USAGE: [eVal,eVec] = InvPower(A,s,maxIter,tol) 
% maxIter = imit on number of Iterations (dqefault is 50) . 


% tol = error tolerance (default 1Is 1.0e-6) . 


If narglin < 4; tol = 1.0e-6; end 


If mnarglin < 3; maxIter = 50; end 

Dn = Size(A,1) ; 

A=A- eyeGCn)xs; % Fortrm A* = A - SI 

A = LUdec(CA) ; % Decompose Ar# 

去 三 工 amd(ny 7 % Seed eligenvecs. with random numbers 
XMag = Sdqrt(dqot(xXx,X)); X = X/AXMag % Normalize 


for 工 = 工 :maxIteT 
XO]1d = 和 X; % Save Current eligenvecs . 
X = IUsolL(A,X); % Solve Ax*X = XO]1d 
XMag = Sdqrt(dqot(X,X)); 和 = X/AXMagi  % Normalize 驻 
XSIgn = Sign(Cdot(xXO1d,X)); % Detect Sign change of 又 
X = XxXSigni; 
% Check for convergence 
If sdqrt(Cdqot(XO1d - X,XO1d - X)) < tol 
eVal = S + XSign/XMag;i eVec = 又 ; 
TetuTrDn 
emnd 
end 


error( TIToo many IteratiIons ') 


EXAMPLE 9.4 
The stress matrix describing the state of stress atapoint is 
-30 10 20 
3S=| 10 40 -50 |MPa 
20 -50 一 10 


Determine the largest principal stress (the eigenvalue of S farthest from zero) by the 
power method. 


Solution First iteration: 


了 
Let 一 区 0 0| be the initial guess for the eigenvector. Then 


一 30 10 20 1 一 30.0 
Z 一 Sv 一 10 40 -50|1|10|= 10.0 
20 -50 一 10||10 20.0 
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lz| = V302 十 102 十 202 二 37.417 








一 30.0 1 一 0.801 77 
一 一 -一 10.0 E 0.267 26 
“二 加 37.417 ， 
20.0 0.534 .52 
Second iteration: 
一 30 10 20 一 0.80177 37.416 
Z 一 Sv 一 10 40 一 50 0.26726 | = | 一 24.053 
20 -50 一 10 0.534 .52 一 34.744 
lz| = V37.4162 十 24.0532 十 34.7442 =- 56.442 
7 37.416 1 0.66291 
一 一 一 | 一 24. 一 一 一 一 | 一 0.42615 
“二 053 | 56442 人 
一 34.744 一 0.615 57 
Third iteration: 
一 30 10 20 0.66291 一 36.460 
Z 一 Sv 一 10 40 一 50 一 0.42615 | 三 20.362 
20 -50 一 10 一 0.61557 40.721 





|z| = V36.4602 十 20.3622 十 40.7212 = 58.328 


， 【=-36.460 一 0.62509 
= 二 =|j 20362 | 一 -= | 0.34909 

"一同 58.328 
40.721 0.69814 


At this point the approximation of the eigenvalue we seek is 和 = -58.328 MPa (the 
negative Sign is determined by the sign reversal of zZ between iterations). This is 
actually close to the second-largest eigenvalue 和 > = -58.39 MPal By continuing the 
iterative prIocess we would eventually end up with the largest eigenvalue 和 3 = 70.94 
MPa. But Since | 和 ?| and | 和 3| are Iather close, the convergence is too Slow from this 
point on for manual labor. Here is a program that does the calculations for us: 


% EXample 9.4 (Power method) 

[-30 10 20; 10 40 -50; 20 -50 -10]; 
[1; 0; 0]; 

for 工 = 工 :100 


Le] 
中 


喝 
中 


VvOld =VviZ= Srvi zMag = sqrt(Cdot(Z,Z)); 
V = Z/zMag;i VvSign = Sign(Cdot(vOl1d,v)) 
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V = VxVSigni; 
If sdqrt(Cdot(vo1d - vv0Old - v)) < 1.0e-6 
eVal = VSiIgnx*ZzMag 
DumItezT = 工 
TetuTrDn 
emnd 
end 


error(' Too many Iterations ) 
The results are: 


>> eVal = 
70.9435 

DuUmItez = 三 
93 


Note that it took 93 iterations to reach conveIgence. 


EXAMPLE 9.5 
Determine the smallest eigenvalue 和 1 and the corresponding eigenvector of 


l]1] 2 3 1 4 

2 9 妃 瑟 汉 
A=|3315 4 3 
195 4 12 4 

42 3 4 17 


Use the inverse power method with eigenvalue shifting knowing that 和 1 之 5. 


solution 
% EXample 9.5 (人 (Inverse power method) 
S= 5 
A= [1I1 2 3 1 4; 
得 号 
3 315 4 3 
1 5 412 4; 
4 2 3 417]); 
[eVal ,eVec] = InVvPower(A,Ss) 


Here is the outpnut: 


>> eVal = 
4.8739 

eVec = 
0-2673 
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-0.7414 
s=0.0502 

0.5949 
-0.1497 


Convergence was achieved with 4 iterations. Without the eigenvalue shift 26 iter- 
ations would be required. 


EXAMPLE 9.6 

Unlike Jacobi diagonalization, the inverse power method lends itself to eigenvalue 
piIoblems ofbanded matrices. Write a program that computes the smallest buckling 
load ofthe beam described in Example 9.3, making full use ofthe banded forms. Run 
the program with 100 interior nodes (7 = 100). 


solution The function invPowers5 listed below returns the smallest eigenvalue and 
the corresponding eigenvector of Ax = 入 Bx where Ais a pentadiagonal matrix and 
B is a sparse matrix (in this problem it is tridiagonaD. The matrix Ais input by its 
diagonals deandfas was done in Art. 2.4in conjunction with the LU decomposition . 
The algorithm for invPower5 doesnotuseB directly but calls the function funcCv) 
that supplies the product Bv. Eigenvalue Shifting is not used. 


function [evVal,evVec] = invPower5(func,d,e,) 

% Finds Smallest eligenvalue of Ax*X = ambdax*Bx*Xx by 
% the inverse power method . 

% USAGE: [eVal,eVec] = InvPower5(func,d,e,E) 

% Matrix A must be pentadliagonal and Stored in form 
% A [fN\eNdxNeNf] ， 


% func handle of function that Teturns Brx*vV. 


nn = Length(Cd) ; 
[de, 节 ] = LUdec5(d,e,) ; % Decompose A 
和 = 工 and(n, 工 ) ; % Seed X with Fandom numbers 
XMag = Sqrt(dqdot(X,X)); X = X/AXMagi % Normalize 芭 
for 研 = 1:50 
XO1Ld = 式 ; % Save CUTTent 芒 
又 = ILUsol5(Cd,e,f,feval(Cfunc,X)) ; % Solve [A]{tx}+f = [B]{XxO1d+ 
XMag = Sdqrt(dqdot(X,X)); X = X/XMagi  % NormaliIze 驻 
XSlign = Sign(Cdqot(CxXO]1d ,X) ) ; % Detect Sign change of 
和 = X*XSIgn; 
% Check for convezrgemnce 
If sqrt(Cdot(xOld - X,XO1d - X)) < 1.0e-6 
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eVal = XSign/XMag;i eVec = 驻 ; 
TetuTrDn 
end 
end 


error( Too many Iterations ') 
The function that computes Bv is 


function BVv = fex9_6(v) 


% Computes the product B*v in Example 9.6. 


nn = lengthCv) ; 
BV = zeros(n,1) ; 


于 OF 土 三 -277 矶 = 工 


Bv(I) = -VCI-1) + 2xV(I) - VCI+1L) ; 
emnd 
卫 友 (工人 三 2VK17 三 到 (2 
BvCn) = -VCn-1) + 2xVCn) i 


Here is the program that calls invPower5: 


% Example 9.6 (Inverse power method for pentadiagonal A) 
= 100 

ones(n,1)*6; 

d(C1) = 5; qGCn) = 7; 

e = ones(Cn-1,1)*(-4); 

荆 ones(n-2,1) ; 

[eVal ,eVec] = invPower5(Qafex9_6,dq,e, 夺 ) ; 

主 砧 苹 卫 下 二 二 (了 二 27/ 工 三 

fprintf(”%9.4f" ,eValx(n+1) 2) 


已 旺 
中 


The output shown below is in excellent agreement with the analytical value. 


> RE 27ETI 三 业 0<1867 


PROBLEM SET 9.1 





1，Given 


过 
心 叫 己 
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convert the eigenvalue problem Ax = 和 Bxto the standard form Hz = 和 . What is 
the relationship betweenXand z? 


2. Convert the eigenvalue prIoblem Ax = 入 Bx, where 


4 一 0 和 ”一 0 
A= | 一 ! 4 一 1 了 = | 一 1 2 一 1 
0 一 1 4 0 = 工 


to the standard form. 


3. An eigenvalue of the problem in Prob. 2 is roughly 2.5. Use the inverse power 
method with eigenvalue shifting to compute this eigenvalue to four decimal 


工 
places. Start with X 一 1 0 0| .771 two iterations should be suffhicient. 


4. The stress matrix atapoint is 


150 -60 0 
S=|-60 120 0|MPa 
0 0 80 


Compute the principal stresses (eigenvalues of S). 





The two pendulums are connected by a spring which is undeformed when the 
pendulums are vertical. The equations of motion of the System can be shown 
to be 


人 7(0> 一 01) 一 111801 一 7101 


一 大 (9> e 01) 和 2111802 一 211502 


where 01 and 92 are the angular displacements and K is the Spring stifftness. 
Determine the circular frequencies of vibration and the relative amplitudes 
of the angular displacements. Use 1 = 0.25 kg, 大 = 20 N/m, 工 =0.75 m and 
g = 9.80665 my/s“. 
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\00000r 
上 
Kirchoff's laws for the electric circuit are 
3 一 瑚 一 为 一 证 
五 十 记 一 参 人 ， 
靖 十 为 一 


Compute the circular frequencies ofthe circuit and the relative amplitudes ofthe 
loop currents. 


7. ComputethematrixA-* thatresults from annihilation of 4i4 and 44l in the matrix 


4 一 1 0 1 工 
A 一 二 6 王 2 0 
0 =2 3: :2 
1 0 2 4 


by a Jacobi rotation. 


8. 国 Use the Jacobi method to determine the eigenvalues and eigenvectors of 


4 一 1 一 2 
A= | 一 1 浊 3 
二 冯 总 1 


with the Jacobi method. 
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10. 


1. 


有 


13. 
14. 


15. 


16. 


国 Usethepowermethodtocomputethelargesteigenvalueandthe corresponding 
eigenvector ofthe matrixA given in Prob. 9. 


看 Find the smallest eigenvalue and the corresponding eigenvector of the matrix 
Ain Prob. 9. Use the inverse power method. 


图 Let 
1.4 0.8 0.4 0.4 一 0.1 0.0 
A=|0.8 6.6 0.8 也 = | 一 0.1 0.4 一 0.1 
0.4 0.8 5.0 0.0 ”一 0.1 0.4 


Find the eigenvalues and eigenvectors ofAx = 和 Bxby the Jacobi method. 
国 Use the inverse power method to compute the smallest eigenvalue in Prob. 12. 


国 Use the Jacobi method to compute the eigenvalues and eigenvectors of the 
matrix 


l]1] 2 3 1 4 2 

2 3 沁 浊 

A 一 3315 4 3 2 
15 412 4 3 

42 3 4 17 5 

21 2 3 5 8 


国 Find the eigenvalues ofAx = 入 Bx by the Jacobi method, where 


6 一 4 1 1 一 2 3 一 
人 A 一 一 4 6 一 4 1 B 二 一 双 6 一 2 3 
1 一 4 6 一 4 3: -一 2 人 = 之 
0 1 一 4 7 二 下 3 一 2 9 


Wzrzz78:Bis notpositive definite. 
国 


汉 
三 





1 2 


Thefigureshowsacantileverbeam with asuperimposedfinite difference mesh. 芷 
2(x, his thelateral displacement ofthe beam, the differential equation ofmotion 
governing bending vibrations is 
0 天 
帮工 
where 7y is the mass per unit length and BT is the bending rigidity. The bound- 
ay conditions are (0, 访 三 (0 六 三 UL ( 代 力 三 2 代 力 =0.， With V(x, 力 三 
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17. 


yy(x) sin wofthe problem becomes 


互 六 】 


J/(0) 








(0) 


J"( 万 ) JJ%( 古 ) 


The corresponding fnite difference equations are 


where 


0 

0 

1 
6 一 4 
一 人 5 
革 三 2 
站 二 多 
7 


) 


0 坝 
0 有 2 
0 JJ53 
1 J/-2 
二 包 J/-1 
1 ] 功 


Jp 一 2 
J 一 1 
Jhn/2 


(al Write downthematrixH ofthe standardform Hz = 和 zandthetransformation 
matrixP as in y = Pz. (b) Write a program that computes the lowest two circular 
frequencies ofthebeam andthe correspondingmodeshapes (eigenvectors) using 
the Jacobimethod. Run the program with 刀 = 10. Note:the analytical solution for 
the lowest circular frequency is wol = (3.515/Z2) VET7]7， 
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(b) 


The simply supported column in Fig. (a) consists of three Segments with the 
bending Tigidities shown. I only the first buckling mode is of interest， it is 
suffhicientto modelhaljfofthe beam as shown in Fig. (b). The differential equation 
for the lateral displacement V(X) is 


几 一 一 


7 


太 
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18. 


9， 


with the boundary conditions (0) = &'(L/2) = 0. The corresponding finite dif- 
ference equations are 


2 一 1 0 0 0 0 0 0 ZI ZI 
一 1 2 一 1 0 0 0 0 0 12 12 
0 一 1 2 一 1 0 0 0 0 13 13 
0 0 一 1 2 一 1 0 0 0 14 ZL4 
0 0 0 一 1 2 一 1 0 0 5 | 一 和信 | /1.5 
0 0 0 0 一 1 2 一 1 0 16 16/2 
0 0 0 0 0 一 1 2 一 1 Z9 19/2 
0 0 0 0 0 0 一 1 业 Zi10 ZI10/4 


where 


天 
三 二 | 二 : 
五 站 人 \20 


Write a prIogram that computes the lowest buckling load P of the column with 
the inverse power method. Utilize the banded forms of the matrices. 








The springs sSupporting the three-bar linkage are undeformed when the linkage 
is horizontal. The equilibrium equations of the linkage in the presence of the 
horizontal force P can be shown to be 


6 5 3 和 六 1 1 1 包 
3 3 2 如 | 三 好 0 1 1 风 
1 1 1 0 0 1 纪 


where jis the Spring stiffness. Determine the smallest buckling load P and the 
Corresponding mode shape. 瓦 71t the equations can easily rewritten in the Stan- 
dard form AO6 = 和 0, where Ais symmetric. 


国 
人 和 了 
31m 21m 


MG 


泌 


了 
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The differential equations of motion for the mass-spring System are 
大 (一 2 三 十 聊 ) = 11 而 
KW 一 212 十 区 ) = 371107 
K(12 一 273) 一 2711015 
where W(D is the displacement of mass ;7 from its equilibrium position and 大 


is the Spring stifftness. Determine the circular frequencies of vibration and the 
corresponding mode shapes. 


20. 力 


上 上 让 上 
000007 \00000x \00000/ \000007 


全 


记 ee 2 624 4 忆 6 


























Kirchoff's equations for the circuit are 














Ci 

了 忆 | 忆 ta zi) 三 0 
1 

2 0 
人 

ee 
4 4 2) 十 一 下 三 0 

62 0 ”0G 

Find the circular frequencies of the currents. 
21.， 力 

C C/2 C/3 C/4 























Determine the circular frequencies of oscillation for the circuit showm, given the 
Kirchoff equations 








Cl Cl  Gl 


1 
E 
dc dj ci 2 
5( 宏 本 ia。 十 世 加 = 0 


2 02 0 
丰 + 人 ( 呈 ) + 站 0 
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025 cd 十 工 Cl25 0 六 3 
Ci2 不 2 di2 dl2 村 
人 2 六 C2 六 4 

下 上 区 
( 5 ) 三 








T 友 一 0 

22. 国 Several iterative methods existfor fnding the eigenvalues ofa matrixA. One of 
these is the ZLR 10etpod, which requires the matrix to be symmetric and positive 
definite. Its algorithm very simple: 


LetAo = 人 A 

do withz = 0, 1,2,... 
Use Choleskis decomposition Ai= LILF to compute Li 
Form Ai = 工 7Li 

end do 


It can be shown thatthe diagonal elements ofAi+l converge to the eigenvalues of 
A. Write a program that imnplements the LR method and test it with 


人 4 
A=|3 
1 


已 心 CD 


工 
2 
3 


Householder Reduction to Tridiagonal Form 


It was mentioned before that Similarity transformations can be used to transform an 
eigenvalue problem to a form that is easier to Solve. The most desirable of the “easy” 
forms is, of course, the diagonal form that results from the Jacobi method. Howeve, 
the Jacobimethod requires about 1073 to 20713 multiplications, so that the amount of 
computation increases veryIapidly with 7. We are generally better offbyreducing the 
matrix to the tridiagonal form, which can be done in precisely 刀 一 2 transformations 
by the Householder method. Once the tridiagonal form is achieved, we still have to 
extract the eigenvalues and the eigenvectors, but there are effective means of dealing 
with that as we see in the next article. 


Householder Matrix 


Householders transformation utilizes the 矶 oxysePpoder 102C17riX 


QQ 王 工 一 一 一 (9.36) 
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whereuis avector and 











1 1 
互 = -uru= 二 |u? 9.37 
|ul 人 ) 
Note that uu7 in Eq. (9.36) is the outer product; that is, a matrix with the elements 
(uu7) 记 二 下 办 Since Q is obviously symmetric (QL = Q), we can write 
灾 到 区 多 T 
总 uu uu uu7 uluruau 
一 一 | 工 工 一 工 一 2 
qaraQ= aq ( 号 儿 亲 
_ 2 UL u(2PDuUT 司 
克 万 2 


which shows that Q is also orthogonal. 
Nowletxbe an aibitrary vector and consider the transformation Qx. Choosing 








U 一 X 十 Kel (9.38) 
where 
了 
K= 土 gx el= 1 0 0 .. 0| 
we get 
we 人 时 ]s[aettar。 
万 万 
uU 人 (xx 二 Keila ul 大 十 Ko) 
于 五 本 瑟 
But 
2 万 = 区 上 + Kel)7 区 +Kel) = 人 xj 二 KE(xrel +efx) 十 KEP2efei 
一 1 二 26 十 居 一 2( 居 二 Ka) 
So that 








季 
Qx=x_-u= -kei | 天 0 0 . 0| (9.39) 


Hence the transformation eliminates all elements ofx except the first one. 


Householder Reduction of a Symmetric Matrix 
Let us now applythe following transformation to asymmetric7x matriXA: 
1 07|14 上 4 2 
PIA=- 1 ”| = 2 (9.40) 
0 Q X AAA Qx QA 
Here X is represents the first column of A with the first element omitted and A- 
is Simply A with its first row and column removed. The matrix Q of dimensions 


361 | 9.4 Householder Reduction to Tridiagonal Form 


(2 一 JI) x (2 一 Jis constructed using Eqs. (9.36)-(9.38). Referring to Eq. (9.39)，we 
see thatthe transformation reduces the first column ofAto 


4l1 
一 天 
411 _| 0 
Qx . 
0 
The transformation 
T 
APIAP = | 人 (Qm (9.41) 
Qx QAQ 


thus tridiagonalizes the firstrow as well as the first column ofA. Here is a diagram of 
the transformation fora4 x 4matrix: 









































110 0 0 4114 4 44 1|10 0 0 
0 421 0 
0 Q | 4 人 0 Q 
0 441 0 
41 | 一 K 0 0 

| 一 K 

| 0 QAQ 
0 














The second row and column of A are reduced next by applying the transformation to 
the3 x 31lower right portion of the matrix. This transformation can be expressed as 
A < P;AP, where now 


了 
P, - | (9.42) 


In Eq. (9.42) lzisa2 x2identitymatrixandQisa(2 一 2) x (2 一 2)matrixconstructed 
bychoosingforxthebottom 刀 一 2elements ofthe second column ofA.Ittakes atotal 
of 7 -2transformations with 


T 于 
| "| 1 一 1,2,... ,7 一 2 
0 Q 


to attain the tridiagonal form. 
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It is wasteful to form P; and then carry out the matrix multiplication PIAPi. We 




















note that 
Uu7 Au 
AQ=A1I = 人 A' 民 =A 一 vu7 
we 
where 
(9.43) 
V 一 5 
万 
Therefore， 
| 
瑟 万 
ulurA)J ulurvur 
到 人 VUT 人 ) 重 人 ) 
瑟 瑟 
=A'-vu -uv 二 2guu7 
where 
了 (9.44) 
已 订 
Letting 
WwW=Vv 一 SU (9.45) 
it can be easily verified that the transformation can be written as 
QAQ =A-wul-uw- (9.46) 


which gives us the following computational procedure which is to be carried out with 
三 22 


1. LetA' bethe (2 一 六 x (1 一 D)lowerright-hand portion of A. 

2 | Ar 427 ji (the column oflength 7 一 7justto the left of 
A)). 

3. Compute I. LetK = II 这 x > 0andK 王 一双 让 2 <0(this choice ofsign mini- 

mijizes the roundofft erroD). 

Letu 一 | rm X 妈 …. 为 让. 

Compnute 五 = |d?/2. 

Computev= Au/ 万 . 

Computeg = urv/(C2 万 . 

Compute w = 了 一 8u. 

Compnute the transformationA 二 A 一 wiu -urw. 

10， Set 和 全 有 疝 地 全 一 夺 . 


是 
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Accumulated Transformation Matrix 


Since we used Similarity transformations, the eigenvalues of the tridiagonal matrix 
are the same as those ofthe original matrix. However to determine the eigenvectors 
Xof originalA we mustuse the transformation 


六 一 了 Xtridiag 
whereP is the accumulation ofthe individual transformations: 
卫 王 PiIP2……P，> 


We build up the accumulated transformation matrix by initializing Pto a mx 
identity matrix and then applying the transformation 


Pi 了 P 07 Pi 了 
PPppi-|-a “2|| 7 | 2Q (b) 
P2 Pzz||10 Q Pl2 P2zQ 
with = 1,2,...,7 一 2.Itcanbeseenthat each multiplication affects only the right- 


most1 一 columns ofP (Since the first row ofPl> contains only zeroes, it can also be 
omitted in the multiplication). Using the notation 


P' 一 P12 
P2> 











we have 
Pi2Q ， 号 ) ， Pu 7 四 
一 PQ=PII 一 了 一 了 一 9.47 
区 qQ ( 万 豆 " 0 1 
where 
加 P'u (9.48) 
7 二 五 


The procedure for carrying out the matrixz multiplication in Eq. (b) is 


。 Retrieve u (in our triangularization procedure the us are stored in the columns 
of the lower triangular portion of A). 

。 Compnute 五 = |ul?/2. 

。 Computey = Pu/ 互 . 

。 Compute the transformation P' < P' 一 yu7. 


国 householder 





This function performs the Householder reduction on the matrix A. Upon return， 
d occupies the principal diagonal of A and c forms the upper subdiagonal; that is， 
d = diag(A) andc = diag(A,1).Theportion of 4belowthe principal diagonal is 
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utilizedto storethevectorsuthatareneededinthe computation ofthetransformation 
matr 这 卫 . 


function A = householder(A) 

% Housholder reduction of A to tridiagonal form A = [cNdxcl]. 
% ExXxtract cC and qd by d = diag(A)，c = qiag(A,1) . 

% USAGE: A = householder(A) 


Dn = Size(A,1) ; 
for K = 1:n-2 
uU = ACk+1:n,K) ; 
UMag = sqrt(Cdot(Cu,u) ) ; 
If u(1L) < 0; UMag = -uUMag;i end 
uC1) = uC1L) + UMag; 
A(Ck+1L:n,K) = Ui % Save U in Lower part of A. 
H = dotGu ul)/2; 
A(Ck+1L:n,Kk+1L:n)xu/H; 
g dotCu v)/C2*H) ; 
V=V- gx*ui 
A(Ck+1:n,Kk+1L:n) = ACK+1:n,Kk+l:n) - Vxru - UxV  i 
A(CK,Kk+1) = -UMasg 


end 


国 householderP 





ThefunctionhouseholderPreturnsthe accumulatedtransformation matrixP.There 
is no need to call it 让 only the eigenvalues are to be computed. Note that the input 
parameter Ais notthe original matrix, but the matrix returned by householder. 


function P = householderP(CA) 

% Computes transformation matrlix P aftemz 

”% householder zeduction of A Is carrlied out . 
% USAGE: P = householderP(CA) . 


nn = SiIze(A,1); 


P = eye(Cn) ; 
for K = 1:n-2 
U = ACK+1:n,K) ; 
H = dotCu ul)/2; 
了 = 了 PCLIDn,KkK+lL:n)*xu/XH; 
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P(1:n,k+lL:n) = PC(1L:n,k+l:n) - Vxu 


end 


EXAMPLE 9.7 
Transform the matr 这 


7 2 3 -1 
二 | 汐 : 和 和 - 
3512 9 
-11 9 7 


into tridiagonal form using Householder reduction. 


Solution Reduce the first row and column: 


8 5 1 2 
A =|5 12 9 X 一 3 厂 三 |IX 一 3.7417 
1 9 7 一 1 
大 十 加 5.7417 1 
u 一 | 加 |= 3 瓦 = 了 af = 21.484 
X3 一 1 
32.967 17225 一 5.7417 
uul = | 17.225 9 一 3 
一 5.7417 =3 1 
1 一 0.53450 ”一 0.80176 0.26725 
Q=I- 页 = 一 0.80176 0.58108 0.13964 
0.26725 0.13964 0.95345 
10.642 ”一 0.1388 ”一 9.1294 
QA'Q = | -0.1388 ”5.9087 ”4.8429 
一 9.1294 4.8429 “10.4480 
7 一 3.7417 0 0 
二 | (QT7 -3.7417 “10.642 -0.1388 -9.1294 
< 一 一 
Qx QAQ 0 -0.1388 ”5.9087 ”4.8429 
0 一 9.1294 4.8429 “10.4480 
色 
In the last step we usedthe formula Qx = | 天 0 0| 
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Reduce the second row and column: 


，_ | 5.9087 “4.8429 、，_ | -0.1388 
4.8429 10.4480 ”| -9.1294 


| KK= 一 |x| = -9.1305 


where the negative sign on was determined by the sign of 2 . 


一 网 1 
四 一 9.1294 2 


T |85.920 84.623 
84.623 83.346 


Q- _uu | 0.01521 一 0.99988 
， ， 瑟 |-0.99988 0.01521 
10.594 4.772 
A'Q = 
Re ， | 
7 一 3.742 0 0 
0 3.742 10.642 “9.131 0 
A< 42>1 4 (Qx) 7 一 2 “ 
0 Qx QAa 0 9.131 10.594 4.772 
和 
0 0 4.772 5.762 


EXAMPLE 9.8 
Use the function householder to tridiagonalize the matrix in Example 9.7; also de- 
termine the transformation matrix 了 . 


solution 
% Example 9.8 (Householder reduction) 
A= [7 2 3 -1 
2 8 5 开 ; 
3 二 二 2 9 
< 业 证 汐 。] 
= householdezr(A) ; 
diag(A)” 
= qiag(A,1)” 
= householderP(CA) 


rdnD 吕 
外 


The results ofrunning the above program are: 


>> d = 
7.0000 10.6429 10 .5942 5.7629 
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9.5 


瑟 . 二 
-3.7417 95309 4.7716 


用 专 
工 .0000 0 0 0 
0 -0.5345 =0:.2551 0.8057 
0 -0.8018 -0.1484 =0.5789 
0 0.2673 -0.9555 =0- 了 252 


Eigenvalues of Symmetric Tridiagonal Matrices 
Sturm 9equence 


In principle, the eigenvalues of a matrix A can be determined by finding the roots of 
the characteristic equation |A-- 和 II = 0.This methodis imnpractical forlarge matrices 
sincethe evaluation ofthe determinant involves 3/3 multiplications. However ifthe 
matrixis tridiagonal (we also assumeitto be symmetric),its characteristicpolynomial 


dl 一 入 Cl 0 0 0 

cad- 和 oc 0 0 

0 C2 Cd3 一 人 C3 0 

POJ=IA-M=| 0 0 ER 0 
0 0 本 0 C1 一 1 Qi 一 人 








can be computed with only3(2- D multiplications using the following sequence of 
operations: 
疡 OA) = 一 1 
疡 (人 ) = 看 一 入 (9.49) 
疡 0 = (及 一 和 PIC) 一 cf 1 忆 >()， 1 三 35 


The polynomials 媚 ( 人 ,已 0, …, 忆 (人 ) form a Stz77a SeqgUe1ce that has the fol- 
lowing property: 


。 Thenumber ofsign changesinthe sequence 站 (g, 疡 (四 ,Pisequaltothe 
numberofroots of P,() thataresmallerthana.Ifamember 己 (aq ofthe sequence 
is zero, its sign is to be taken opposite to that of 忆 _1(O). 


As we see Shortly Sturm Sequence property makes itrelativelyeasyto bracketthe 
eigenvalues of a tridiagonal matrix. 
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国 StUTrmSed 


Given the diagonals canddofA= [c\dcl, and the value of 和, this function returns 
the Sturm sequence 有 OA), 已 OP().Notethat P) =|A 一 入 芽 . 


function pP = sturmSedq(Cc,dq, Lambda) 

% Returns Sturm Sequence P associated with 

% the tridiagonal matrlix A = [cNdxc] and Lambda . 
% USAGE: Pp = sturmSedq(Cc,dq, Lambda) . 

% Note that |A - JIambdax*I| = pGCn) . 


吕 
中 


ength(dq) + 工 ; 

P = ones(Gn,1); 

p(2) = qdq(1) - lambda 

for 工 = 2:Dn-I 

DCi+1) = (dqGE) = Lambda)*D(I) = (CCI-I2 2 )*PpCIE- 工 )3 


end 


国 COUnt_eVals 





This function counts the number of sign changes in the Sturm sequence and returns 
thenumber of eigenvalues ofthe matrixA = [c\dNcl that are smaller than 入 . 


function num_eVals = count_eVals(Cc,dqd,1ambda) 

% Counts eigenvalues smaller than Lambda of matYTIX 
%A= [cxdNxc]. Uses the Sturm sedquence . 

% USAGE : num_eVals = count_eVals(Cc,d, Lambda) . 


P sturmSedq(c,dq,Lambda) ; 
n = engthCpP); 
oldSign = 1; num_eVals = 0 
forzr 工 = 2:0n 
PSign = SIgnCP(I) D) ; 
If pSign == 0; PSign = -olLdSign;i end 
If PSignx*oldSign < 0 
num_eVals = mnum_eVals + 工 ; 
end 
OoJLdSign = PSign; 


emnd 
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EXAMPLE 9.9 
Use the Sturm sequence property to Show that the smallest eigenvalue ofAis in the 
interval (0.25, 0.5) where 


一 2 一 工 0 
0 一 一 
0 0 = 2 


Solution Taking 和 = 0.5, we have 不- 和 =1.5andcf =1andthe Sturm sequence 
in Eqs. (9.49) becomes 


证 (0.5) 一 工 

己 (0.5) = 1.5 

忆 (0.5) = 1.5(1.5) 一 虐 = 1.25 

让 (0 中 5UL25 5 和 .375 

忆 (0.5) = 1.5(0.375) 一 1.25 = 一 0.6875 


Since the sequence contains one Sign change, there exists one eigenvalue smaller 
than 0.5. 
Repeating the process with 入 = 0.25 (G@ 一 入 = 1.75， 全 | 一 ]), we get 


记 (0.25) = 王 工 

户 (0.25) = 1.75 

忆 (0.25) = 1.75(1.75) 一 工 =2.0625 

局 (0.25) = 1.75(2.0625) 一 1.75 = 1.8594 
性 (0.25) = 1.75(1.8594) 一 2.0625 = 1.1915 


There are no sign changes in the sequence, So that all the eigenvalues are greater than 
0.25. We thus conclude that 0.25 < 和 1 < 0.5. 


Gerschgorin's Theorem 


Gerschgorins theorem is useful in determining the g/opa/! pov7ds on the eigenvalues 
ofan7x71matrixA.The term "global means the bounds that enclose all the eigen- 
values. We give here a simplified version of the theorem for a symmetric matrix. 


。 I 和 is an eigenvalue ofA, then 


秦王 让 加 大 二 丰 于 研 ]123554 克 
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where 


Zi 一 4 万 一 >》 ， 1 4 (9.50) 


It follows thatthe global bounds on the eigenvalues are 


Xmin 之 min(wi 一 方 ) 和 max < Inax(Gi 十 方 ) (9.51) 
了 攻 


国 5ezSchgorIn 





The function gerschgorin returns the lower and the upper 由 obal bounds on the 
eigenvalues of a symmetric tridiagonal matrixA = [c\dNc]. 


function [eValMin,eValMaxj]= gerschgorinGCc,d) 
% Evaluates the glLobal bounds on eligenvalues 
% of A = [cNdxc]. 

”% USAGE : [evValMin,eValMax]= gerschgorinCc,d) . 


nn = Length(Cdq) ; 

eValMin = dq(1) - abs(Cc(C1)) ; 

eValLMaXX d(1) + abs(CcC1) ) ; 

fozr 工 = 2:n-1 
eVal = dq(I) - abs( 人 c(I)) - abs(CcCI-1L)) ; 
If eVal < eValMin;i eValMin = eVal;i end 
eVal = dq(I) + abs( 人 Cc(Ci)) + abs(CcCI-I1L) ) ; 
If eVal > eValMax;i eValMaXx = eVal;i end 


end 

eVal = dqGCn) - abs(CcCn-1)); 

If eVal < eValMin;i eValMin = eVal;i end 
eVal = dqGCn) + abs(CcCn-1) ) ; 

If eVal > eValMax; eValMaXx = eVal;i end 


EXAMPLE 9.10 
Use Gerschgorins theorem to determine the global bounds on the eigenvalues of the 
matrix 
4 -2 0 
A=|-2 4 一 2 
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solution Referring to Eqs. (9.50), we get 
01 一 4 02 一 4 0G3 一 5 
他 壹 汉 7 一 4 15 二 2 
了 ence 
和 min > Imin(di 一 门 王 4 一 4=0 


和 Xmax < max(Q 十 门 二 4 十 4=8 
Bracketing Eigenvalues 
The Sturm sequence pIoperty together with Gerschgorins theorem pIovides us con- 


venient tools for bracketing each eigenvalue of a symmetric tridiagonal matrix. 


国 eVa]lBTFackets 





The function eValBrackets brackets the 1 smallest eigenvalues of a Symmetric 
tridiagonal matrA= [c\dNcl. It returns the Sequence 三 ,72, ,7 where each 
interval (mr, mi+1) contains exactly one eigenvalue. The algorithm first fmnds the global 
bounds on the eigenvalues by Gerschgorins theorem. The method of bisection in 
conjunction with the Sturm sequence property is then used to determine the upper 
bounds on 和, 和 jj, ...,X1inthat order. 


function TY = eValLlBrackets(Cc,d,m) 

% Brackets each of the m Jowest eligenvalues of A = [cNdxcj] 
% So that there Is one elvenvalue in [YY(I)，YCi+lL)]. 

% USAGE: TYT = eValBrackets(Cc,dq,m) . 


[eValMin,eValMax]= gerschgorinGc,dqd); % Findqd glLobal Limits 
zz = ones(Cm+1,1); TY(1L) = eValMin; 
% Search for eligenvalues :in dqescendjing ordemz 
for KK = m:-I: 工 
% First bisection of :Interval (eValMin ,eValMax) 
eVal = (eValMax + eValLMjin)/2; 
Ph = (eValMax - eValMin)/2; 
for 工 = 工 :100 
% Find pnumbez of eligenvalues Jess than eVal 
num_eVals = count_eVals(Cc,d,eVvVal) ; 


% Bisect again K& findqd the half containing eVal 
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nh = Ph/2; 
If num_eVals < K ; eVal = eVal + hi 
elselif num_eVals > K ;) eVal = eVal - hi 
else;i break 
end 
end 
% If eligenvalue located，change Uppezr Limit of 
% Search and Tecord TeSsult :in {T} 
ValLlMaXx = eVal;i TYCk+1) = eVal; 


end 


EXAMPLE 9.11 
Bracket each eigenvalue ofthe matrix in Example 9.10. 


solution In Example 9.10wefoundthat all the eigenvalues lie in (0, 8). Wenowbisect 
this interval and use the Sturm sequence to determine the number of eigenvalues in 
(0,4). With 和 = 4, the Sequence is 一 See Eqs. (9.49) 

记 (=1 


记 4) 三 4 一 4=0 





已 =(4-4(0) 一 220) = 一 4 





忆 ( = (5 一 4(-4 一 2200) = 一 4 


Since a zero value is assigned the Sign opposite to that of the preceding member the 
Signs in this sequence are (十 , 一 , 一 , 一 ). The one sign change shows the presence of 
one eigenvalue in (0, 4). 

Next we bisect the interval (4, 8) and compute the Sturm Sequence with 入 = 6: 


让 6) = 
已 (6) =4 一 6= 一 2 





书 (60) = 4-6)(-2) 一 220)=0 





忆 (60) = G6 -6)(0) 一 22(-2) =8 


In this sequence the Signs are (十 , 一 , 十 , 二) indicating two eigenvalues in (0, 6). 
Therefore 
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Computation of Eigenvalues 


Once the desired eigenvalues are bracketed, they can be found by determining the 
roots of P,( 入 ) = 0 with bisection or Brents method. 


国 eIgenvals3 





The function eigenvals3 computes the 17 Smallest eigenvalues of a Symmetric 
tridiagonal matrix with the method of Brent. 


function eVals = eligenvals3(C,D,m) 
% Computes the smallest m eligenvalues of A = [CNDNC]. 
% USAGE: eVals = eligenvals3(C,D,m) . 
%C and D must be delared "glLobal” in cal1ing progtram. 


eVals = Zeros(Cm,1) ; 

Y = eValBrackets(C,D,m); % Bracket eligenvalues 

for 工 = 工 :m 
% Solve |A - eValx*I| for eVal by Brent's method 
eVals(I) = brent(Qfunc ,CI) ,ECI+L) ) ; 


end 


function 工 = funcCeVal) ; 


% Returns |A - eValx*I| (Last_ element of Sturm seq.) 


glLobal C D 
PD = sturmSeq(C,D,eVal) ; 
荆 = DCLengthCP)); 


EXAMPLE 9.12 
Determine the three smallest eigenvalues ofthe 100 x 100 matrix 


2 -1 0 0 
1 0 
0 


A_-|0-l1 2 
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solution 

% EXxample 9.12 (Eigenvals. of tridiagonal matLrIX) 
format Short e 

glLobal C D 

m=3;) mn= 100; 

D = ones(n ,17)*2; 

C = -ones(Cn-1,1); 


elIgenvalues = eligenvals3(C,D,m) 
The result is 


>> elgenvalues = 
9.6744e-004 3.8688e-003 8.7013e-003 


Computation of Eigenvectors 


I the eigenvalues are known (approximate values will be good enough), the best 
means of computing the corresponding eigenvectors is the inverse power method 
with eigenvalue shifting. This method was discussed before, but the algorithm did 
not take advantage of banding. Here we present a version of the method written for 
Symmetric tridiagonal matrices. 


国 InZPoweTr3 





This function is very similar to invPower listed in Art. 9.3, but executes much faster 
Since it exploits the tridiagonal structure of the matrix. 


function [eVal,eVec] = InvPower3(Cc,dq,s,maxIter ,tol) 

% Computes the eligenvalue of A =[cNdNxc] closest to s and 
% the associated eligenvector by the :inverse Power method ， 
% USAGE : [evVal,eVec] = InvPower3(c,dq,s,maxIter ,tol) . 

% maxIter = imit on numbet of Iterations (dqefault is 50) . 


% tol = error tolerance (default 1Is 1.0e-6) . 


If mnargin < 5; tol = 1.0e-6; end 


If nargin < 4; maxIter = 50; end 

nn = Length(Cd) ; 

e=cjd=d- s; % Apply shift to diag.， tetrms of A 
[c,d,e]l = LUdec3(c,de); % Decompose Ar* = A - SI 

过 三 : 玉 可 和 O《 王 》3 % Seed X with Tandom numbers 


XMag = Sdqrt(dot(X,X)); X = X/XMagi % Normalize 叉 
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for 工 = 工 :maxItez 
XXX91Q 三 区 ; % Save CUFrTent 式 
和 三 工 Usol3k(CcQdey 共 7 % Solve Ar*X = XO1d 
XMag = Sdqrt(dot(X,X)); X = X/XMagi  % NormaliIze 驻 
XS1iIgn = Sign(Cdqot(CXO1d,X) ) ; % Detect sign change of 广 
X = XxXSiIgn; 
% Check for convezrgence 
If sqrt(Cdot(xXOl1d - X,XO1d - X)) < tol 
eVal = ss + XSlign/XMagi;i eVec = Xi 
TeturDn 
end 
emnd 


erTror( Too many Iterations ') 


EXAMPLE 9.13 
Compute the 10th smallest eigenvalue of the matrix A given in Example 9.12. 


solution The following program extracts the 7 th eigenvalue of A by the inverse 
power method with eigenvalue shifting: 


ExXample 9.13 (Eligenvals， of tridiagonal matrIX) 


format Short e 


m = 10 
二 三 工 003; 
d = ones(n,1)*2; C = -ones(Cn-1,1) ; 


YY = eValBrackets(Cc,dq,m) ; 
s =(TCm) + ICm+1I7)D)V2; 
[eVal,eVec] = InvPower3(Cc,dq,s); 


mth_eligenvalue = eVal 


The result is 


10 
mth_eligenvalue 
9.5974e-002 


EXAMPLE 9.14 
Compnute the three smallest eigenvalues and the corresponding eigenvectors of the 
matrixA in Example 9.5. 


symmetric Matrix Eigenvalue Problems 


solution 
% EXxample 9.14 (Eigenvalue Prob]lem) 
glLobal C D 
m= 3; 
A= [11 2 3 1 4; 
2 9 号 5 23 
3 315 4 3 
1 5 412 4; 
4 2 3 417]; 
eVecMat = zeros( 人 (size(A,1) ,my) ; % Init .eligenvector matTrIX . 
A = householder(A) ; % Tridiagonalize A. 
D = qiag(A); C = qiag(A,1) ; % EXxtract diagonals of A. 
P = householderP(CA) ; % _ Compute tranf. matrix 了 P. 
eVals = elgenvals3(C,D,m) ; % Find Lowest m eligenvals . 
fozr 工 = 工 :m % Compute corresponding 
S = eVals(I)*1.0000001; 9%6 egenvectors by Inverse 
[eVal ,eVec] = invPower3(C,D,s); % Power method with 
eVecMat(:, 革 ) = eVec 9%6 edIgenvalue shifting . 
end 
eVecMat = P*eVecMat ; % Eigenvectors of orlig. A. 
elIgenvalues = eVals， 
elIgenvectors = eVecMat 


>> elgenvalues = 


4.8739 8.6636 10.9368 
elIgenvectors = 

=0c2673 05729 竹 0.5058 

0.7414 0.4139 -0.3188 

0.0502 -0.4299 0.5208 

-0.5949 0.0696 -0.6029 


0.1497 -0.3278 -0.0884 


PROBLEM SET 9.2 





1， Use Gerschgorins theorem to determine global bounds on the eigenvalues of 


10 4 一 1 4 2 一 2 
(a] A=| 4 2 3 (b) B== 2 5 忆 
= 业 己 6 -2 3 4 
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2. Use the Sturm sequence to show that 


has one eigenvalue in the interval (2, 4). 


3. Bracket each eigenvalue of 


4 -1 0 
A=|-1 4 一 ! 
0 -1 4 
4. Bracket each eigenvalue of 
6 1 0 
A=|1 8 2 
和 2 
5. Bracket every eigenvalue of 
-1 0 0 
A_| 一 1 2 -1 0 
-1 2 -=! 


6. Tridiagonalize the matriX 


]2 4 3 
A=|49 3 
3 3 195 


with Householders reduction . 


7. Use Householders reduction to transform the matri 


to tridiagonal form 
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8. 国 Compute all the eigenvalues of 


6 2 0 0 0 

2.520 0 

A=|0274 0 

0046 1 

0001 3 

9. 国 Find the smallest two eigenvalues of 

4 -1 0 1 
A|= 1 6 -2 0 
0 =2 3 2 
1 0 2 14 


and the corresponding eigenvectors. 


11. 国 Find the two smallest eigenvalues ofthe6 x 6 Hilbert matri 


1 1/2 1/3 .…， 1/6 
1/2 1/3 1/4 1/7 
A_|13 14 1/5 .…，1/8 
1/6 1/7 1/8 .JI 


Recall thatthis matrix is 刘 -conditioned. 


12. 国 Rewrite the function eValBrackets So that it will bracket the 7 largest 
eigenvalues of a tridiagonal matrix. Use this function to bracket the two largest 
eigenvalues of the Hilbert matrix in Prob. 11. 


13.， 力 


KE 






SS 
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14. 


JJ 


The differential equations of motion of the mass-spring system are 
大 (一 2 由 十 研 ) = 11 而 
K(W 一 27o 十 6) = 3710 克 
K(zo 一 216) 一 21177 


where 由 (is the displacement of mass ;i from its equilibrium position and Kis 
the Spring stiffness.Substituting 怒 擅 三 入 Sin oo weobtain thematrixeigenvalue 
problem 





2 
中 | 遍 | 志 朗 [下 区 计 | 咽 
二 雪人 才 | 疙 | 二 一 | 和 3 六 | 六 
0 -1 2| | 入 0 0 2|| 入 


Determine the circular frequencies w and the corresponding relative amplitudes 
儿 of Vibration . 





一 L{ 一 LUD 上 LU 














[ 





区 


Thefigure shows identical masses connected by springs of different stiffnesses. 
Theequation governing freevibration ofthe systemis Au = 2o2u where wis the 
circular frequency and 


石 十 名 一 应 0 0 … 0 
一 应 记 十 应 一 启 0 … 0 
中 
人 A== . . 
0 下 0 一 后 -1 及-1 十 各 一 怠 
0 四 0 0 一 操 1 


亚 
Giventhespringstifftness arrayk 一 | 名 …， 时 | ,Writeaprogramthatcomputes 


the Nlowest eigenvalues 和 = 1w2 and the corresponding eigenvectors. Run the 
prIogram with NW=4and 


到 
k= |400 400 400 02 400 400 200| kN 


Notethatthe system is weaklycoupled 上 abeingsmall.Dotheresults make sense? 


















































SS 
匡 
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16， 


The differential equation of motion of the axially vibrating bar is 


// 人 站 

下 
where V(x, Dis the axial displacement, po represents the mass densityand PE is the 
modulus of elasticity The boundary conditions are V(0, 必 = 凤 ( 代 , 力 =0.Letting 


2U(X, 力 一]J(O0 Sin wwe obtain 


1 


2 0 
万 ]J(0) = (D=0 


The corresponding fnite difference equations are 


]J “= 一 0 


2 一 1 0 0 …: 0 菇 J1 
一 1 2 一 1 0 0 ]2 ]/2 
0 -1 2 -1 . 0|| 入 oO p | Ja 
| 也 | : 
0 0 .一 | 2 一 1 Jp-1 Jp-1 
0 0 …: 0 一 1 1 ] ]J5/2 


(a] Hthe standard form of these equations is Hz = 和 Z, write down H and the 
transformation matrixzP in y = Pz. (b) Compute the lowest circular frequency of 
thebar with 刀 = 10, 100 and 1000utilizingthemodule inversePower3.Vote:the 
analytical solution is wl = VE7]7O/ (2 万 ). 

国 





























The Simply supported column is resting on an elastic foundation of stiffness 大 
(Nm per meter lengthb). An axial force P acts on the column. The differential 
equation and the boundary conditions for the lateral displacement are 


已 大 
由 十 一 砂 十 二 -UV=0 
尼 十 再 十 王 77 


U(0) = WU (0) = VD) = CC =0 








Using the mesh shown, the finite difference approximation ofthese equations is 
(5 十 a)U1 一 4t2 十 13s 三 入 (21 一 Z2) 
一 4 而 十 (6 十 a)U2 一 4V3 十 24 三 入 (一 2 十 272 十 13) 


2Ul 一 4t2 十 (6 十 a)Uas 一 4 十 25 三 入 (一 2 十 213 一 Z4) 
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Zi-3 一 4-2 十 (6 十 al 一 42 三 入 ( 一 Up-2 十 200-1 一 2 
Zi 2 一 4 1 十 (十 QJZ 一 入 (一 Up_l 十 271 八 


where 
kj 1 了 PP 1  PZ? 
ET (2 二 D4 BT7 





人 一 





本 +Dz BI 
Write a program that computes the lowest three buckling loads P and the corre- 
Sponding mode shapes. Run the program with KL4/(ET) = 1000 and7= 25. 


17. 四 Find smallest five eigenvalues of the 20 x 20 matri 


210 0 :01 

121 0 .00 

012 1 :00 
A=- 罗 

0 0 1 2 10 

0 0 1 1 

1 0 0 0 12 


Note:this is a ditficult matrix that has many pairs ofdouble eigenvalues. 


IIATLAB Functions 


MATILAB s function for solving eigenvalue problems is eig. Its usage forthe standard 
eigenvalue prIoblem Ax = 和 X is 


eVals = elig(A) Ieturns the eigenvalues ofthe matrixA (A can be unsymmetric). 


[X,D] = eig(A) returns the eigenvector matrixX and the diagonal matrix D that 
contains the eigenvalues on its diagonal; thatis, evals = diag(D). 


For the nonstandard form Ax = 入 Bx, the calls are 


eVals 


eIg(A,B) 
[X,D] 


eIg(A,B) 


The method of solution is based on Scjzzrs jzctorizatiozmx: PAP7= 世 where P 
andTare unitary and triangular matrices, Tespectively Schurs factorization is not 
covered in this text. 


10 


10.1 





Introduction to Optimization 


Findxthat minimizes 焉 GO subjectto sg =0, Pa >0 


Introduction 


Opli7707zafomis theterm oftenusedforminimizing ormaximizing afunction.Itis suf- 
ficientto considertheproblem ofminimization only; maximization of 大 Co is achieved 
bysimplyminimizing -有 .Inengineering, optimization is closelyrelated to design. 
The function Co, calledthe 12e7ztj12ctio1 or Opjective jjpctiom is the quantity that 
we wish to keep as Small as possible, such as cost or weight. The components of X, 
known as the desig7 GT7iCpies, are the quantities that we are free to adjust. Physical 
dimensions (lengths, areas, angles, etc.) are common examples of design variables,. 

Optimizationisalargetopicwithmanybooks dedicatedtoit.Thebestwe can do in 
limited space is to introduce afewbasic methods that are good enough for problems 
that are reasonably well behaved and dont involve too many design variables. By 
omitting the more Sophisticated methods, we may actually not miss all that much. 
All optimization algorithmas are unreliable to a degree 一 any one ofthem may work on 
one problem and fail on another. As arule ofthumb, bygoingup in sophistication we 
gain computational eficiency but not necessarily reliability. 

The algorithms for minimization are iterative procedures that require starting 
values of the design variables X. 玉 下 Cg) has Several local minima, the initial choice of 
xdetermines which ofthese will be computed. There is no guaranteed way offinding 
the global optimal point. One suggested procedure is to make several computer runs 
using different starting points and pick the best result. 

More often than not, the design is also Subjected to restrictions，OT co7S17Qz72， 
which may have the form of equalities or inequalities. As an example, take the min- 
imum weight design of a roof truss that has to carry a certain loading. Assume that 
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thelayout ofthe members is given, So thatthe design variables are the cross-Sectional 
areas of the members. Here the design is dominated by inequality constraints that 
consist of prescribed upper limits on the stresses and possibly the displacements，. 

The majority of available methods are designed for 1zco1sS1Gi72ed op 厄 71272C1O71， 
where no restrictions are placed on the design variables. In these problems the min- 
ima, 让 they exit are stationary points (points where gradient vector of 下 Cg vanishes). 
In the more difficult problem of comstazmpzed op171272ato1 the minima are usuallylo- 
cated where the 有 GO surface meets the constraints. There are Special algorithms for 
constrained optimization, but they are not easily accessible due to their complexity 
and Specialization. One way to tackle a problem with constraints is to use an Uncon- 
strained optimization algorithm, but modify the merit function so that any Violation 
of constraints is heavily penalized. 

Consider the problem of minimizing G) where the design variables are Subject 
to the constraints 


三 二 (10.1a) 
1 < 0，7=12...，N (10.1b) 

We choose the new merit function be 
天 O 一 民 OO 二 TAXPOO (10.2a) 


where 


M N 
Pa = 》 [8002+》 {max[0, 记 四 二 (10.2b) 
1 姜 1 
is the pe1djty jzctioaand 和 isamultiplier The function max(a, 站 returns the larger 
of da and D. It is evident that PO = 0 让 no constraints are violated. Violation of a 
constraint imposes a penalty proportional to the square of the violation. Hence the 
minimization algorithm tends to avoid the violations, the degree of avoidance being 
dependent on the magnitude of 和. 开 和 is Small optimization will proceed faster be- 
cause there is more “Space" in which the procedure can operate, but there may be 
Significant violation of constraints. On the other hand, alarge 和 canresultin apoorly 
conditioned procedure, but the constraints will be tightly enforced. It is advisable to 
run the optimization program with 和 that is on the Small side. Hthe results show un- 
acceptable constraint violation, increase 和 and run the program again, starting with 
the results ofthe previous run. 

An optimization procedure may also _ become 计 -conditioned when the con- 
straints have widely different magnitudes. This problem can be alleviated by scal1z78 
the offending constraints; that is, multiplying the constraint equations by Suitable 
constants，. 
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10.2 Minimization Along a Line 


帮 J 







Local minimum 


Eigure 10.1. Example oflocal and global minima. 






Global minimum 
Constraint boundaries 





Considerthe problem ofminimizing afunction 太 x) ofasingle variable x with the 
constraints c<Xx<dAhypothetical plot ofthe function is shown in Fig. 10.1. There 
aretwominimum points: astationarypoint characterizedby 广 (x) = 0thatrepresents 
alocal minimum, and aglobal minimum at the constraint boundary. It appears that 
fnding the global minimum is simple. All the stationary points could be located by 
fnding the roots ofd1dx = 0, and each constraint boundary may be checked for a 
gobal minimum by evaluating j 太 cc) and 帮 G). Then why do weneed an optimization 
algorithm? We need 让 让 太 o is difficult or imnpossible to differentiate; for example, 让 
Jrepresents a complex computer algorithm. 


Bracketing 


Before aminimization algorithm can be entered, the minimum point must be brack- 
eted. The procedure of bracketing is simple: start with an initial value of xzo and move 
dow1Pzi computing the function at xl, xz, X3,.. .until we Ieach the point 2 where 
Jincreases for the first time. The minimum point is now bracketed in the inter- 
val (Xi 2, X%). What should the step size 户 =X%4+1 一 be?rItisnotagoodidea have 
a constant 访 Since it often results in too many steps. A more ef 性 cient scheme is to 
increase the size with every step, the goal being to reach the minimum quickly even 
这 the resulting bracket is wide. We chose to increase the step Size by a constant factor; 
thatis, we use ji1 = c 有 cc > 1 


Golden Section Search 


The golden section search is the counterpart of bisection used in finding roots of 
equations. Suppose that the minimum of 太 x) has been bracketed in the interval 
(四 oflength 妃 . To telescope the interval we evaluate the function at xl 一刀 一 民 P 
and xz 一 0 十 尺 P as Shown in Fig. 10.2(a). The constant 及 will be determined shortly. 
开户 > Pasindicatedinthefigure,theminimum lies in (xl, 媚 ; otherwise itis located 
in (C, X2). 


385 | 10.2 Minimization Along a Line 


1 ? 























2Rh-h? 
及 户 
上 Rn 
腿 h] 
X 
也 XX X 
1 太 2 
(a) Figure 10.2. Golden section telescoping. 
帮 J | 
[Ph 
Ci 
X 











忆 X1 X2 局 
人 
(b 


Assumingthat 户 > 户 wesetda <Xlandxl 二 YX2,whichyieldsanewinterval (C, 刀 of 
length7 = RPasillustratedin Fig.10.2(b).TIo carryoutthenexttelescoping operation 
we evaluate the function at xz = Q@ 十 Randrepeat the process，. 

The procedure works only 计 Figs. 10.1(aj and (bj are simijlar; ie., 让 the Same 
constant 民 locates Xl and xz in both fgures. Referring to Fig. 10.2(aj, we note that 
X2 一 X1 一 2R17 一 几 The same distance in Fig. 10.2(b) is xl 一 4 和 = 太一 人 REquating 
the two, we get 


2R7 一 天 一 太 一 开矿 
Substituting 大 = Rand cancelling 屎 yields 

2 中 一 三 并 由 一 用 
the solution of which is the golden 7atio21: 


一 1+V5 
加 2 


玉 一 0.618033989 ... (10.3) 


Notethat each telescoping decreases the interval containingthe minimum bythe 
factor 丸 which is not as good as the factor of 0.5 in bisection. However the golden 
Search method achieves this reduction with o7e jzctio7m evatio1， whereas two 
evaluations would be needed in bisection. 

ThenumberoftelescopingsrequiredtoreducepfromIBp-altoanerrortolerance 
s is given by 


ID 一 CR 一 < 


21 Ristheratio ofthe sides ofa“golden rectangle,”considered by ancient Greeks to have the perfect 
pIoportions. 
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which yields 





ln(s/ID 一 aq) GE 
本 证 一 一 2.078087ln 二 (10.4) 


国 5O]LdBTacket 





This function contains the bracketing algorithm. For the factor that multiplies Suc- 
cessive search intervals we chosec 王 1 十 卫 . 


function [a,b] = goldBracket(Cfunc,Xx1lL,Ph) 
% Brackets the minimum Point of ECx) . 
% USAGE: [a,b] = goldqdBracket(func,XxStart,h) 


% INPUT : 

% func = handle of function that Teturns 工 (X) . 
% XI = Starting Value of X. 

% hh = :initial step Size used :in search , 

% OUTPUT : 


% a，b = Jimits on X at the minimum Point . 


cC = 1.618033989 ; 
下 芋 三 本 GaLKCEUDG 7 
X2 = XlL + h;i f2 = fevalCfunc,X2); 
% Determjine downhill1 direction & change Sign of h If needed . 
王 丰 在 2 光 坦 于 
Ph = -hi 
X2 = XlL + h;i f2 = fevalCfunc,X2); 
% Check If minimum Is between X1 - h and X1 + ph 
了 本 2 六” 二 半 
避 三 区 2 由 三 环卫 二 G 七 二 过 
emnd 
emnd 
% Search oop 
for 工 = 1:100 


科 二 : 生生 
X3 = X2 + h; f3 = feval(Cfunc,X3); 
斌 下 王 3. 文 - 二 2 


aa =XL;i b =X3; Tetuzn 


end 


error( ”goldbracket did not find minimum ”7) 
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国 g5oLdSearch 





This function implements the golden section search algorithm. 


function [XxMin,fMin] = goldSearchCfunc,a,b,tol) 
% Golden section search for the minimum of 工 (X) . 
% The minimum point must be bracketed in a <= X <= hb. 
% USAGE : [EMin,xMin] = goldSearchCfunc ,XStart ,hy) 


% INPUT : 

2% 二 ne = handle of function that Teturns 工 (X) . 

% a，b = Jimits of the interval containing the minimum . 
%- 示 D 工 = error tolerance (default is 1.0e-6) . 

% OUTPUT : 


% fMin = miInimum Value of f(X) . 


% XMin = value of xX at the minimum Point . 


If narglin < 4; tol = 1.0e-6; end 

DnIter = celil(-2.078087*1og(Ctol/abs(Cb-a))) ; 
R = 0.618033989 ; 

C=1.0 - 有 R; 

% _ First telescoping 

XL = Rx*a + Crxrb; 

X2 = Cxa 二 Rrbi 

乓 下 feval(Cfunc ,X1) ; 

打 和 feval(Cfunc ,X2) ; 

% Malin Loop 


for 工 =1:nItez 


王 和 二 之 
a= XL; XL = X2;i flL = f2; 
X2 = Crxa 二 Rx*bi 
f2 = feval(func,X2) 1; 
else 
车 三 ”区 关注 二 文 直 3 二 2 三 皇 工 ， 
XL = Rxa + Crxrb; 
f1 = fevalCfunc,X1) ; 
end 
end 
王 主 手 开 才 ] 王 2 汪 M 和 三 二 工 汪 勾 MIi 三 区 二 ， 


else; fMin = f2; XMin = X2; 


emnd 
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EXAMPLE 10.1 
Use goldSearch to fndxthat minimizes 


Fo = 1.6 妈 十 3 妇 一 27 
Subject to the constraint x > 0. Compare the result with the analytical solution . 


solution This is a constrained minimization problem. Either the minimum of 六 oo is 
astationarypointinx > 0,oritislocatedatthe constraintboundaryx = 0.Wehandle 
the constraint with the penalty function method byminimizing 太 2xo0 十 和 [min(0， 功 ] 。 

Startingatx=1andchoosing 下 = 0.1forthefirststep Sizein goldBracket (both 
choices being rather arbitrary), we arrive at the following program: 


% Example 10.1 (golden section minimization) 
区 三 97 和 三 05 工 : 

[a,b] = golLdBracket(Cafex10_1,X,h); 
[xMin,fMin] = golLldSearchCQfex10_1,a,b) 


The function to be minimized is 


function Y = fex10_1(CxX) 


% Function used :in Example 10.1. 


Lam = 1.0; ”% Penalty function mulLtip1Liez 
cC = min(0.0,X); % Constraint benalty equatIon 
YY=1.6*X 3 + 3.0*X"2 - 2.0*X + amx*c“`2; 


The output from the program is 


>> XM1in = 
0.2735 

fMin = 
-0.2899 


Since the minimnum was found to be a stationary point the constraint was not 
active. Therefore, the penalty function was Superfluous, but we did not know that at 
the beginning. 

The locations of stationary points are obtained analytically by solving 





Pog0 =4.8z2 二 6x 一 2=0 


The positive root of this equation is X = 0.273 494. As this is the only positive root 
there are no other stationary points in X > 0that we must check out. The only other 
possible location of a minimum is the constraint boundaryX = 0.But here j 太 0) =0 
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is larger than the function at the stationary point leading to the conclusion that the 
8obal minimum occurs at X = 0.273 494. 


EXAMPLE 10.2 


人 人 
TS 
5 人 


6 ”| 





风 





The trapezoid shown is the cross section of a beam. It is formed by removing the top 
from atriangle ofbase= 48mmandheight 互 = 60mm.Theproblem is to find the 
height y ofthe trapezoid that maximizes the section modulus 


= 三 f/C 


where Fis the second moment of the cross-sectional area about the axis that passes 
through the centroid C of the cross section. By optimizing the section modulus， 
we minimize the maximum bending stress cmax = M/S in the beam，M being the 
bending moment. 


solution Considering the area of the trapezoid as a composite of a rectangle and 
two triangles，we find the section modulus through the following sequence of 




















computations: 
Base ofrectangle 20 一 也 ( 互 一 妇 /所 
Base of triangle D=(B 一 OO/]/2 
Area 4=(B+OJA2 
First moment of area about X-axis Qx = (C])J/2 十 2(D/2) /3 
Location of centroid Q=Qr/4 
Distance involvedin S C 王 一 人 





Second moment of area about X-axis | 有 = dy3/3 十 2( 思 3/12) 





Parallel axis theorem 到 一 五 一 4d2 














Section modulus SS 一 玉 /c 
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10.3 


We could use the formulas in the table to derive S as an explicit function of ]J，but 
that would involve a lot of error-prone algebra and result in an overly complicated 
expression. It makes more Sense to let the computer do the work. 
Theprogramweusedislistedbelow.Aswewishtomaximize9gwithaminimization 
algorithm, the merit function is --S. There are no constraints in this problem. 


% EXxample 10.2 (Foot findqing with golden section) 
SS 二 证 60.03 上 二 荆 0; 

[a,b] = golLldBracket(CQafex10_2,yStart,h); 

[yopt ,Sopt] = golLldSearchCQfex10_2,a,b); 
fprintf('optimal y = %7.4fNn ,yopt) 
fprintf(C'optimal S = %7.2f"',-Sopt) 


The function that computes the section modulus is 


function S = fex1l10_2(y) 

% Function used :in Example 10.2 
= 48.0; 下 = 60.0; 

= Bx*(GH - yY)/XH; b= (B - a)/2.0; 
= (BE + a)xy/2.0; 

(Caxy 20)7250 十 飞 DxY 2J73505 

= QL 人 Ac=yYy- di 

= (ax*y “3)/3.0 + (bxy “3)/6.0; 
Ibar = 工 - A*d 2; S = -Ibar/c 


FmRDDDPnp 
外 


Here is the outpnut: 


optimal yY = 52.1763 
7864.43 


optimal S 


The section modulus of the original triangle is 7200; thus the optimal section 
modulus is a 9.2% improvement over the triangle. 


Conjugate Gradient Methods 
Introduction 


Wenowlook at optimization in -dimensional design space. The objective is to min- 
imize Fwhere the components ofx are the 7 independent design variables. One 
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way to tackle the problem is to use a Succession of one-dimensional minimizations 
to close in on the optimal point. The basic strategy is 


。 Chooseapoint xo in the design space. 
。 loop with = 1,2,3,... 
Choose avector Vi. 
Minimize Fo alongthelinethroughxi -iinthedirection ofv.Lettheminimum 
point be 天 
让 jx 一 Xi-1| < s exitloop 


。 endloop 


The minimization along a line can be accomplished with any one-dimensional 
optimization algorithm (Such as the golden section search). The only question left 
open is how to choose the vectors Vi， 


Conjugate Directions 


Consider the quadratic function 
1 
太公) 一 C 一 2 填 了 起 1] 


1 
一 C 一 bTx 十 5X Ax (10.5) 


Difterentiation with respect to Xi yields 


0 玉 


雹 一 一 尺 十 4 


which can be written in vector notation as 
VE=--b 二 Ax (10.6) 


where VP is the 87Cdiemt of 下 . 
Nowconsiderthe changeinthe gradientas wemovefrompointxo in the direction 
of a vector u. The motion takes place along the line 


X 一 Xo 十 SU 


where s is the distance moved. Substitution into Eq. (10.6) yields the expression for 
the gradient along 7: 


VElx+rsu=-bp+AGCo+sD=VPFlx+sSAu 
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Note thatthe changein the gradientissAu. Ifthis changeis perpendicular to avector 
Vi that is, 这 


VIAu=0 (10.7) 


the directions of u and v are said to be mutually co771zsgate (noninterfering). The 
implication is that once we have minimized PC in the direction ofv we can move 
alonguwithout ruining the previous minimization . 

For a quadratic function of independent variables it is possible to construct 刀 
mutually conjugate directions. Therefore,itwouldtakeprecisely7 line minimizations 
alongthese directions to reachtheminimnumpoint.IFGisnotaquadraticfunction， 
Eq. (10.5) can be treated as a local approximation of the merit function, obtained by 
truncating the Taylor series exzpansion of 下 CO about xo (See Appendix ADJ): 


1 
G 之 丰 Go) 十 VEFGo)G 一 Xo) 十 了 区 一 xo)7HCxo)(GX 一 xo) 


Now the conjugate directions based on the quadratic form are only approximations,， 
valid in the close Vicinity of xo. Consequently it would take several cycles of 0 line 
minimizations to reach the optimal point. 

Thevarious conjugate gradientmethodsuse differenttechniquesfor constructing 
conjugate directions. The so-called ze7o-o1der 1aepods worIk with 下 CO only whereas 
the jirst-order 17etpods utilize both Fa and VF.The first-order methods are com- 
putationally more efficient of course, but the input of VF (fitis available at al can 
be very tedious. 


Powell's Method 


Powells method is a zero-order method, requiring the evaluation of FCoO only Ithe 
piIoblem involves 7 design variables, the basic algorithm is 


。 Chooseapointxo in the design Space. 


。 Choose the starting vectorsVi,Ii 一 1,2,...,1(theusual choiceisvi = et where ei 
is the unit vector in the 习 -coordinate direction). 
。 Cycle 


do withz 一 1,2,...，,7 
Minimize 和 CO along the line through xi-l in the direction of vi. Let the 
minimum point be Xi 
end do 
Vn+Hl < X0 一 Xi (this vectoris conjugate to vtl produced in the previous loop) 
MinimizeFCoalongthelinethroughxointhe direction ofvl.Lettheminimum 
point be xn+1. 
让 |xn+l 一 xol < s exit loop 
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do withz 一 1,2,...，,7 
Vi < 二 Vil(mis discarded, the other vectors are reused) 
end do 


。 end cycle 


Powell demonstrated that the vectors va+l produced in successive cycles are mu- 
tually conjugate, So that the minimnum point of a quadratic surface is reached in 
precisely 7 cycles. In practice, the merit function is seldom quadratic, but as long as 
it can be approximated locally by Eq. (10.5), Powells method will work. Of course, 让 
usuallytakesmorethan 7 cyclesto arriveattheminimum ofanonquadratic function , 
Note that it takes 7 line minimizations to construct each conjugate direction. 

Figure 10.3(a) ilustrates one typical cycle of the method in a two dimensional 
design space (1 = 2). We start with point xo and vectors Vv1 and vz. Then we find the 
distance Si that minimizes 已 Cxo + sSvh, fnishing up at point xl = xo 十 SIV1. Next we 
determine S> that minimizes 已 (xl 十 Svz), which takes Us to Xo2 一 Xl 十 S>V2z. The last 
Search direction is vs = xz 一 xXo. After fnding ss by minimizing 焉 Cxo 十 SVva) we get to 
Xs = Xo 十 S3Va, COmpleting the cycle. 





Figure 10.3. The method of Powell. 


Figure 10.3(b) shows the moves carried out in two cycles superimposed on the 
contour map of a quadratic surface. As explained before, the first cycle starts at point 
本 andends upat 户 . The second cycle takes us to 记 , which is the optimal point. The 
directions 古 声 and 户 六 aremutually conjugate. 

Powells method does have amajor faw that has to be remedied 一 让 己 CO is not 
aduadratic, the algorithm tends to produce search directions that gradually become 
linearly dependent thereby ruining the progress towards the minimum. The source 
of the problem is the automatic discarding of vi at the end of each cycle. It has been 
Suggestedthatitis betterto throwoutthe direction thatresultedin the /C7gestdecrease 
of Fo,apolicythatwe adopt. Itseems counterintuitive to discard the best directionm， 
butitis likelyto be closeto the direction addedin the next cycle, thereby contributing 
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to linear dependence. As a result of the change, the search directions cease to be 
mutually conjugate, so that a quadratic form is not minimized in 7 cycles any more. 
This is not a significant loss since in practice 严 C is seldom a quadratic anyway. 

Powell suggested a few other refinements to Speed Up convergence. Since they 


complicate the bookkeeping considerably we did not imnplement them. 


国 DOwe】] 二 


The algorithm for Powells method is listed below. It utilizes two arrays: dqf contains 
the decreases of the merit function in the first 72 moves of a cycle, and the matrix u 


Stores the corresponding direction vectors vi(one vector per colummy). 


function [xxMin,fMin,nCyc] = Powell1(h,tol) 


% 
% 
% 
% 
% 
% 
% 
% 
% 
% 
% 
% 


Powel11lL's method for minimizing 夺 (CX1L,x2,，...，xn) . 
USAGE : [xxMin,fMin,nCyc] = Powell1(h,tol) 


INPUT : 
了 = Initial search Increment (default = 0.1) . 
tol = error tolerance (default = 1.0e-6) . 


GLOBALS (must be declared GLOBAL in cal1ling Program) : 


又 = starting point 


FUNC = handle of function that returns 工 . 


OUTPUT : 


XMin = minimum point 


fMin = miminum Value of 工 


DCyc = number of cycles to convezgence 


glLobal X FUNC V 


If narglin < 2; tol = 1.0e-6; end 


If nargin < 1; h = 0.1; end 


If Size(X,2) > 1;X= Xi end %Xmustbe column vector 


nn = Length(CX) ; % Number of deslign variables 
df = Zeros(n,1); % Decreases of 下 stored here 
U = eye(Cn) ; %_ Columns of U store search directions V 
for j = 1:30 % ALlow up to 30 cycles 

XO1Ld = ; 

foO1d = fevalLl(CEFUNC,XxO1d) ; 

% First Dn Line Searches Tecord the qdqecrease of 工 

for 工 = 工 :nm 

区 和 (二 


[a,b] = golLdBracket(CafLine,0.0,h); 
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[s,fMin] = goldSearchCQefLine,a,b); 
df(I) = f0O1d - fMini 
f01d = fMini 
X=X+SxVi 
end 
% Last 1ine Search :in the cycle 
V=X- XOldi; 
[a,b] = goldBracket(CafLine,0.0,h); 
[s,fMin] = goldSearch(CQefLine,a,，b); 
X=X+SxVi 
% Check for convezrgence 
If sqrt(Cdot(X-XO1d,X-XO1d)An) < tol 
XMin = Xi， PnCyc = jj; Teturn 
emnd 
% Identify biggest decrease of f & update Search 
% directions 
Max 三 工 y 忆 fMax 三 间 皇 (1) ; 
for 工 = 2:0n 
If df( 人 iT) > dfMax 
Max 三 工 y 记 fMa 三 避 皇 (入 
emnd 
emnd 
for 工 = IMax:n-I 
过 (《 工 3 下 了 二) 三 通 (d 于 夺 于 7 
end 
(7 前半 三 V 
emnd 


erTor( ”Powell method did pnot converge ) 


function Z = fLine(s) % 了 in the search direction V 
glLobal X FUNC V 
Z = fevalCEUNC ,X+Sx*V) 


EXAMPLE 10.3 
Find the minimum ofthe function22 
已 = 1000 一 xz 十 (一 加 


22 From Shoup, 工 E.,andMistree,E, Optiraization Metpodswitihi4pplicatiorsjprPersozza1Comzjprters， 
Prentice-Hall 1987. 
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with Powells method starting at the point (一 1, 1). This function has an interesting 
topology. The minimum value of Foccurs at the point (1, 1). As seen in the figure， 
there is ahump between the starting and minimum points which the algorithm must 
Degotiate. 


oo 
< 女 E 
< 





solution The program that solves this unconstrained optimization problem is 


% ExXample 10.3 (Powel1l's method of minimization) 
glLobal X FUNC 

EUNC = Qfex10_3; 

X= [-1.0; 1.0]; 


[XMin ,EMin,numCycles] = powel1 


Note that powe1l1l receivesX and the function handle FUNC as gLobal variables. 
The routine for the function to be minimized is 


function Y = fex10_3(X) 
Y= 100.0x*(XC2) - XC1L) 2) 2 + (1.0 -XC1)7) > 2; 


Here are the resuljts: 


>> XMin = 
工 .0000 
工 .0000 
EMin = 
工 .0072e-024 
DumCycles = 
12 
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EXAMPLE 10.4 
Use powel1l to determine the Smallest distance from the point (5, 8) to the curve 
XyY = 5， 


solution This is a constrained optimization problem: minimize F(x,J = (一 5)2 十 
( 履 一 8)” (the square ofthe distance) subjectto theequality constraint xy 一 5 = 0.The 
following program uses Powells method with penalty function: 


% EXample 10.4 (Powel1l1's method of minimizatIion) 
gJLobal X FUNC 

EUNC = Qfex10_4; 

X 三 [1 .07 520]; 

[XMin,fMin,nCyc] = Powell1; 

fprintf( Intersection point = %8.5f %8.5fNn',XCIL) ,XC2)D) 
XY = XCI)*XC27) 3; 

fpPTintf( ”Constraint X*y = %8.5ftNn' ,XY) 

dist = Sqrt((XC1) - 5.0) 2 + (X(C2) - 8.0) 2) 
fprintf('Distance = %8.5fNn' ,qist) 

fprintf( Number of cycles = %2.0f ,nnCyc) 


The penalty is incorporated in the M-file ofthe function to be minimized: 


function Y = fex10_4(X) 

% Function used in Example 10.4 

Lam = 工 .0; % Penalty mulLtip1Liez 
总 滞 二 (本 二 儿 ( 有 7 二 ”5.0 % Constraint equatIon 
distSq = (XC1) - 5.0) "2 + (XC2) - 8.0) 2 
YY=distsSq + Lamx*c 2; 


As mentioned before, the value of the penalty function multiplier 和 (called Lam 
in the program) can have profound effects on the result. We chose 和 = 1 (as Shown in 
the listing of fex10_4) with the following result: 


>> Intersection point = 0.73307 7.58776 
Comnstralint Xx*y = 5.56234 
Distance = 4.28680 


Number of cycles = 7 


The small value of 和 favored Speed of convergence over accuracy Since the viola- 
tion of the constraint xy = 5 is clearly unacceptable, we ran the program again with 
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入 = 10000 and changedthe startingpoint to (0.733 07, 7.58776), the end point of the 
first run. The results shown below are now acceptable. 


>>Intersection polint = 0.65561 7.62654 
Constraint xx*y = 5.00006 

Distance = 4.36041 

Number of cycles = 4 


Couldwehaveused 人 = 10000inthe firstrun? Inthis case we wouldbelucky and 
obtain the minimum in 17 cycles. Hence we Save only Six cycles by using two runs. 
Howevebn alarge 和 often causes the algorithm to hang up, so that it generally wise to 
start with a Small 入. 


Fletcher-Reeves Method 


Letus assume again thatthe meritfunction hasthe quadratic form in Eq. (10.5). Given 
a direction V, it took Powells method 7 line minimizations to construct a conjugate 
direction. We can reduce this to asingle line minimization with a first-order method. 
Here is the procedure, known as the Fletcher-Reeves method: 


。 Choose a starting point x0. 

。 8 和 一 VC) 

。 Vo < 8 (acking a previous search direction, we choose the steepest descent), 
。 loop with = 0, 1,2,... 


Minimize OO along vi letthe minimum point be Xi+1. 
8 < 一 VFGCG+D)， 
让 |gs| < s orlIFGor -FEGo)| < s exitloop (convergence criteriom). 
7 < (8 SHA (Si 8 
ViH1L < 8+1 十 XYVi， 
。 end loop 


It can be Shown that vi and vi+l are mutually conjugate; that is, they satisfy the 
relationship v: Avil = 0.Alsogi.g+1=0. 
The Fletcher-Reeves method will fnd the minimum of a quadratic function in 
7 iterations. 下 忆 CO is not quadratic, it is necessary to Iestart the process after eveIVy 
7 iterations.Avariant ofthe Fletcher-Reeves method replaces the expression for y by 
(gr+1 一 8) 8 
Foradquadratic 下 (X) this chnange makes no difference since g and g&i+1 are orthogonal. 
However for merit functions that arenotquadratic, Eq. (10.6) is claimed to eliminate 
the need for a restart after 7 iterations. 


(10.6) 
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国 工 ]etcherReeves 





function [xxMin,fMin,nCyc] = fletcherReeves(h,tol) 

% FlLetcher-Reeves method for minimizing fCX1,x2,，...,，Xn) ， 
% USAGE : [xMin,fMin,nCyc] = fletcherReeves(h ,tol) 

% INPUT : 

% 
% tol = error tolerance (default = 1.0e-6) . 

% GLOBALS (must be declared GLOBAL in cal1ing program) : 


Initial search Increment (default = 0.1). 


9% 叉 = Starting Point . 

”% FUNC = handle of function that Teturns 了 . 

% DEFEUNC = handle of function that freturns grad(CE) ， 
% OUTPUT : 


% XMin = minimum point . 
% fMin = miminum value of 工 . 


% mnCyc = number of cycles to convergence . 


gLobal X FUNC DEFUNC V 
If narglin < 2;j tol = 1.0e-6; end 
If nargin < 1; hn = 0.1; end 


If size(X,2) > 1;X= Xi end % Xmust be column vector 


nn = Length(CX) ; % Number of design variables 
g0 = -feval(CDFUNC,X) ; 
V = 8g0; 


for 工 = 1:50 
[a,b] = goldBracket(QafLine,0.0,h); 
[s ,fMin] = goldSearch(CQafLine,a,b); 
X=X+SxVi 
gL = -feval(CDFUNC,X) ; 
If sqrt(Cdot(g1L,g1L)) <= to 

XMin = X; mnCyc = 工 eturn 

end 
gamma = qot((g1 - gg0),Sg1L)/dot(g0,g0) ; 
V = glL + gammaxVi 
Sg0 = SI1; 

emnd 


eTrTor( "Fletcher-Reeves method did not converge ) 


function Z = fLine(s) % 了 in the search direction V 
glLobal X FUNC V 
Z = feval(CEUNC,X+S*V) 
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EXAMPLE 10.5 
Use the Fletcher-Reeves method to locate the minimum of 


了 0 三 10XG4 昌 3 地 一 10X1X2 十 2X1 
汪 
Start with xo 一 |。 0] 8 


solution Since 忆 CoO is quadratic, we need only two iterations. The gradient of F is 


NE 区 一 | 


一 10X1 十 6X2 


First iteration: 


一 2 一 2 一 2 
a--vrm=| 间 wm-| x+sem=| | 


FSs) = FGx +svo) = 10(2s) 十 3(0) 2 -10(--2s)(0) + 2( 一 2s) 
一 408s2 一 45 


PS)=80s 一 4=0 = 0.05 


0 一 2 一 0.1 


-20(-0.D0 + 10(0) | 国 | 0 | 


Second iteration: 


8 = 一 VFGCoO) = | 





10(-0.D - 6(0) 一 1.0 
-8 8 _L0_055 
go . go 4 


-0.1 .05 _0.1 0.5$ 
| 8 


js) = CGI 十 SV1) 
= 10(-0.1- 0.5s) ”十 3(-- 2 -- 10(--0.1 - 0.5s)( 一 s) 十 2( 一 0.1 -0.55) 
一 0.5S2 -一 0.1 
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Psl)=s-1=0 S 一 1.0 


| 汪汪 | 二 | 二 | 6 
2 | -10| | -=-10 
We have now reached the minimum point. 


EXAMPLE 10.6 





























已 


The fgure shows the cross Section of a channel carrying water. Determine 用 已 
andob that minimize the length of the wetted perimeter while maintaining a crosS- 
Sectional area of 8 m2. (Minimizing the wetted perimeter results in least resistance to 
the flow.) Use the Fletcher-Reeves mathod. 


solution The cross-sectional area of the chanpnel is 
4= 3 [+(D+21tang0)] 居 = (二 Ptano0) 有 太 
andthe length ofthe wetted perimeter is 
9 一 DT+2(Ppsec0) 
The optimization problem can be cast as 
Iminimize 卫 十 27secO 
Subjectto (十 Ptan0)P=8 


Equaljlity constraints can often be used to eliminate some ofthe design variables. 
In this case we can Solve the area constraint for 六 obtaining 


了 一 一 Ptano0 


Substituting the result into the expression for 9, we get 


二 一 Ptan0 十 27secb 


We have now arrived at an Unconstrained optimization problem of fnding 疡 and0 
that minimize 9. The gradient ofthe merit function is 


全 3S/ 反 | | -8/ 良 一 tang 十 2secb 
|8S/86 | | -jpsec20 十 2Ppsecotang 
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7 有 
Letting X 一 [2 g| and starting with xXo 一 | > 0] ，we arrive at the folowing 
piIogram: 


% EXample 10.6 (Minimization with Fletcher-Reeves) 
glLobal X FUNC DEFUNC 

FUNC = Qfex10_6; DEFUNC = Qdfex10_6; 

X= [2.0;0.0]; 

[xMin ,EMin,nCyc] = fletcherReeves ; 

b =8.0/XCL) - XCL)*tamnCXC2) 7) ; 

theta = XC2)x*180.0/pPI; % Convert into degrees 
盖 ejiea 南 9 二 二 国 胃 e， %8 :5 下 二 5 让 9 

于 站 王 革 简直 于 6 下 %8 .5 芋 N 达 CID) 

fprintf(C'theta = %8.5fNn ,theta) 
fprintf('perimeter = %8.5fNn',fMin) 


fprintf('numbezr of cycles = %2.0f',nCyc) 


Note that the starting point X and the function handles FUNC (function defining 
) and DFUNC (function defining VP) are declared global. The M-files for the two 
functions are 


function YY = fex10_6(X) 
% Function defining F in ExXxample 10.6 
Y = 8.0/XC1I) - XC1L)*(Ctan(XC2)) - 2.0/cos(X(C27)77) 1; 


function g = dfex1l0_6(X) 

”% Function defining grad(CE) in Example 10.6 

gg = Zeros(2,1) ; 

g(C1) -8.0/(XC1) 2) - tan(CX(C(2)) + 2.0/cos(CXC2) ) ; 

g&(C2) X(C1L)*(-1.0/cos(X(C(2)) + 2.0x*tan(XC(2)))Xcos(CX(C2)) ; 


The results are (0 is in degrees): 


>> b = 2.48161 

Ph= 2.14914 

theta = 30.00000 
pezimeter = 7.44484 


Dumber of cycles = 5 
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PROBLEM SET 10.1 


1 国 The Lennard-Jones potential between two molecules is 
Tv\12 O\6 
=4|( 人 -人 (| 
太 厂 
wheresandec are constants, andris the distance between the molecules.Usethe 


functions goldBracketandgoldSearchtofindo/rthatminimizesthepotential 
and verify the result analytically. 








2 国 One wave function ofthe hydrogen atom is 
少 =C(27 一 18c 十 202)e 0 
where 


0 一 go1/a0 


SI 
81V3zr \G0 


2 一 nuclear charge 





020 一 Bohr radius 


广 一 Tadial distance 


Find c whereV is at aminimum. Verify the result analytically. 


3. 国 Determine the parameter pthat minimizes the integral 
丈 
上 Sin Xcos PXGX 
0 


矶 1 大 use numerical quadrature to evaluate the integral. 


4.， 国 





E= 120V-。 书 ER=129 














Kirchoff's equations for the two loops ofthe electrical circuit are 
玉 辣 十 RD 十 RD 一 z) 一 王 
Pi 二 RiP+R2z+R 一 ) 一 0 


Find the resistance 丸 that maximizes the power dissipated by 尺 . 万 1 大 Solve 
Kirchoff's equations numerically with one ofthe functions in Chapter 2. 
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D， 国 






















































































































































































A wire carrying an electric current is Surrounded by rubber insulation of outer 
radius 7. The resistance of the wire generates heat, which is conducted through 
the insulation and convected into the Surrounding air. The temperature of the 
wire can be shown to be 


7_ 9 (22+ + 下 





2 于 7 


where 


9 =rate ofheat generation in wire = 50 W/m 
Q=Iadius ofwire = 5 mm 

上 = thermal conductivity ofrubber = 0.16 W/m . 开 

户 = convective heat-transfer coefficient = 20 W/m2 . 开 


Tx = ambienttemperature 一 280 下 


Findr thatminimizes 了 . 


6. 国 Minimize the function 
FU 人 = 人 一 DT 二 DY 一 切 


Subject to the constraintsX 十 y<Landx>0.6. 


7. 国 Find the minimum ofthe function 
下 Oo 用 =6 妈 十 扫 十 2y 


iny > 0. Verify the result analytically. 
8. 国 Solve Prob.7 让 the constraint is chnanged to yy > 一 2. 


9. 国 Determine the smallest distance from the point (1, 2) to the parabola ) = 充 2。 
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10， 轩 


0.4 m 





0.4 m 


Determine x that minimizes the distance &between the base of the area Shown 
and its centroid C. 


1， 国 









































The cylindrical vessel of mass M has its center of gravity at C. The water in 
the vessel has a _ depth Xx. Determine X So that the center of gravity of the 
Vessel-water combination is as low as possible. Use M = 115 kg, 互 = 0.8 m and 
7 广 三 :0.25imi 


12， 国 





王 亲 一 | 























The sheet of cardboard is folded along the dashed lines to form a box with 
an open top. If the volume of the box is to be 1.0 m3，determine the dimen- 
Sions CQ and pp that would use the least amount of cardboard. Verify the result 
analytically. 
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13， 团 











The elastic cord 4BC has an extensional stiffness 上 . When the vertical force P is 
applied at B, the cord deforms to the shape 4B'C. The potential energy of the 
System in the deformed position is 





KE(Z 十 首 KK(Z 十 站 
人 64p 十 一 2 38C 
where 
64p 一 VC 十 划 2 十 2 一 0 





pc = 一 VD 一 功 ? 十 2 一 冯 


are the elongations of 4B and BC. Determine the displacements andvbymin- 
imizing V (this is an application of the principle of minimum potential energy: 
a System is in stable equijlibrium 让 its potential energy is at a minimum). Use 
2 一 150mnm,Dp=50mm 大 =0.6Nmmand=5N. 


14.， 转 








尸 = 50 kN 


Each member of the truss has a cross-Sectional area 4. Find 4 and the angle 0 
that minimize the volume 

04 

Cos6 





of the material in the truss without Violating the constraints 


a <150 MPa 06<5mm 
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where 


0 一 一 一 一 Stressin each member 
24Ssinb 


， PD 
2F4sin20sinb 


and 巨 = 200 x 10? Pa. 
15. 国 Solve Prob. 14 计 the allowable displacement is changed to 2.5 mm. 
16.， 转 


= displacementat theload 己 


站 户 
L= 1.0 m 
< 人 
The cantilever beam of circular cross section is to have the smallest volume pos- 
Sible subject to constraints 














0l 和 180 MPa 02 180 MPa 6 < 25 mm 





where 

8PLF 

0l1 = 一 了 王 Imaximum stress in left half 
区 万 
4L 

02 = 一 了 = 三 maximum stress in right half 
区 用 
4PL3 /7 1 

8 三 一 displacement at free end 

3z 忆 已 | P 


and 巨 = 200 GPa. Determine 六 and 靖 . 


17. 国 Find the minimum ofthe function 
FUxz,] 习 =272 十 3 十 2 十 zy 十 XZ 一 27 


and confirm the result analytically. 
18， 国 








The cylindrical container has a conical bottom and an open top. Ithe volume TV 
ofthe container is to be 1.0 ms, fnd the dimensions ,Pand pthat minimize the 
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SuUirface area 9. Note that 


六 
也 = 天 r2 | = 十 大 
元 丰 (+ 同 


S=zr(27+Vb2 十 户 ) 


19， 国 





The equilibrium equations of the truss shown are 





4 3 
c1 人 十 2 息 = 655242 十 c34 一 卫 


where ci is the axial stress in member 7 and 4i are the cross-Ssectional areas. 
The third equation is Supplied by compatibility (geometrical constraints on the 
elongations of the members): 


16 





9 
Ci 5c2 十 53 二 0 


Find the cross-sectional areas of the members that minimize the weight of the 
truss without the stresses exceeding 150 MPa. 


20. 轩 











W2 | 心 5 
Acablesupportedattheends carriesthe weights Wi and W2.Thepotential energy 
of the System is 
了 = 一 Wai 一 了 册 2y2 


一 一 MLisinol 一 Wisinol 十 上 LSsino0>) 
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and the geometric constraints are 
ZL1cosol 十 Lzcosoz 十 La3cos63 一 也 
LiSsinol 十 L2Ssinog 十 L3Sino03s 一 万 


The principle of minimum potential energy states that the equilibrium config- 
uration of the System is the one that Satisfies geometric constraints and mini- 
mizes the potential energy Determine the equilibrium values of 1, 9> and 03 
giventhatZLl = 1.2m,ZLz=1.5m,ZL3s=1.0m 了 =3.5m=0W1I=20kNand 
W2 = 30 kN. 


IIATLAB Functions 


驻 


= fmnbnd(Ce@func,a,b) returns x that minimizes the function func of a single 


variable. The minimum pointmustbe bracketedin (a,b).Thealgorithm used 
is Be1s 1etpod that combines golden section Search with quadratic interpo- 
lation. It is more efficient than goldSearch that uses just the golden section 
Search. 


= fminsearch(CaQfunc,xStart) returnsthevectorofindependentvariables that 


minimizes the multivariate function func. The vector xStart contains the 
Starting values of x. The algorithm is the Nelde 一 Mead 17e 如 od, also known 
as the dowPPz11sI7Plex which is reliable, but much less efficient than Powells 
method. 


Both of these functions can be called with various control options that set op- 


timization parameters (e.g., the error tolerance) and control the display of resuljts. 
There are also additional output parameters thatmaybeusedin the function call as 
jlustrated in the following example (the data is taken from Example 10.4): 


认 


[x,fmin,output] = fminsearchCQfex10_4,[1 5]) 


0.73831 7.5878 


fmin = 


18.6929 


output = 


Iterations: 38 
funcCount : 72 


alLgorithm: "Nelder-Mead simplex direct search” 


A1 
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Taylor Series 
Function of a Single Variable 


The Taylor series expansion of a function jx about the pointx= ais the infinite 
Series 


(一 、 (一 2 


FF = OO+ PPOK 一 o 相 + 大 一 一 一 十 大 (OO 十 …: (Al) 





In the Special case & = 0 the series is also known as the MacLCVT1iI7 Series. It can be 
Shown that the Taylor series expansion is unique in the sense that no two functions 
have identical Taylor series. 

A TIaylor series is meaningful only 让 all the derivatives of jx) existatx 王 0and 
the series converIges. In general conveIgence oOCccuUIS only 让 Xis sufficiently close to 0; 
ie 过 |x 一 Gd < swheresiscalledthe 7adius ofcompvergemce.Inmanycasessisinfinite. 

Another useful form of the Taylor series is the expansion about an arbitrary 
value of X: 

2 3 


JRT+ 朋 = Ja+T 大 OP 大 加 页 十 太 加 可 十 (A2) 








Since it is not possible to evaluate all the terms of an infinite series, the effect of 
truncating the series in Eq. (A2) is of great practical imnportance. Keeping the first 
1 十 lterms, wehave 


万? 有 
JET 月 = 十 户 OF 厂 O0 下 站 帮 ”00 古 十 忆 ， (A3) 
where BE is the 1 厅 rcatio7 error (Sum of the truncated terms). The bounds on the 
truncation error are given by 7T2Jlors 态 eo7e110: 
万 A+1 


(2 十 JJ)! 人 





瓦 = or0G) 
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where 5 is some point in the interval (x,X 十 万 . Note that the expression for 已， is 
identical to the first discarded term of the series, but with x replaced by 5. Since the 
value of 5 is undetermined (only its limits are knownj, the most we can get out of 
Eq. (A4) are the upper and lower bounds on the truncation erITor. 

If the expression for ForD(5) is not available, the information conveyed by 
Eq. (A4) is reduced to 


万 , = O(PAHDH) (A5) 


which is a concise way of saying that the truncation error is of tpe order of 1z+1 or 
behaves as 1+l. 玉 Pis within the radius of convergence, then 


@O(1 门 一 O(Ppo+D1) 


je the erroris always reducedifaterm is addedto thetruncated series (this maynot 
be true for the first few terms). 
In the Special case 九 = 1 Taylors theorem is known as the 112eC71 VC1Ue 态 eo7e170: 


xz 二 月 = OO 二 + 万国 有 < 三 X 十 大 (A6) 


Function of Several Variables 





I 太 is afunction of the 1 variables xx,...，,Xom then its Taylor series exzpansion 
aboutthe pointX 王 [0, 筷 ,. ,Xis 
8 11 7172 
b) 一 应 有 十 …， A 

ge+D) = /am+2 站 本 RE | j 十 (A7) 

This is sometimes written as 
1 
Je+a= Jo+VY7eo:h+5nh Hooh+… (A8) 

The vector V 太 is known as the 8radiezf of 厂 and the matrix His called the Fessia7 
1MC1TrixX of 三. 
EXAMPLE A1 


Derive the Taylor series expansion of Fx) = In(o aboutx = 1. 
solution The derivatives of 广 are 
1 1 21 3! 
/ // /1/ (4) 
人 一 和 三 三 二 二 全 一 一 一 etc. 
三 (0 三 (2 雹 三 (0 5 厂 本 
Evaluating the derivatives atXx = 1 we get 


FPD=1l1 PPOD=-L1 jD=2 90)= -3letc. 


A1 Taylor series 


which upon substitution into Eq. (Al) together with = 1 yields 








112 113 114 
CD ED CD 


全 玫 二 放 阿 3 而 





(一 了 J) 二 ji 和 二 二 1 上 作证 
加 2 3 4 


EXAMPLE A2 
Use the first five terms ofthe Taylor series expansion ofex aboutX = 0: 
二 3 入 


together with the error estimate to find the bounds of e. 





Solution 
人 
量 2 6 24 24 
15 6 
有 二 二 和 二 
The bounds on the truncation error are 
e0 1 el e 
( 4)min 51 120 [ 4)max 51 120 


Thus thelower bound on eis 





0 
andthe upperbound is given by 


65. -这 
emax 一 区 十 120 
Which yieldqs 
119 65 325 
120 ”24 9 
Therefore， 
163 325 
一 一 < 届 
60 - 一 119 
EXAMPLE A3 


Compute the gradient and the Hessian matrix of 


Fe 八 =InVx2 十 ] 


atthe pointx= 一 2,] = 1. 
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Solution 





0 矿 】 下 2 芳 0 矿 
本 必 /X2 十 ]2  X2 十 ]2 38y  X2 十 ]2 


0X /12 十] 


工 
VjJe 用 =|zo2+ 雪 VC2+J| 


VJC2.D=|-04 02] 


82 2 二 一 XC2 一 友 十 芒 








DX2 (X2 十 J2)2 (X2 十 ]2)2 
32 太 光 2 雪 

9]2 (X2 十 ]2)2 

02 太 592 一 2Xy 





xy 8y8xX  (xX2 十 ]2)2 


一 X2 十 ]” 一 2Xy 下 
H 至 Si 
(， J 切 ， X2 EE 池 (X2 平 ]J2)? 
本 | 
0.16 0.12 


A2 “Matrix Algebra 


Amatrix is arectangular array of numbers. The size of a matrix is determined by the 
number ofrows and columns, also called the di;77e1sio1s ofthe matrix. Thus a matr 这 
of Tows and 7 columns is said to have the size 1 x 7. (the number ofrows is always 
listed firsb.Aparticularly important matrix is the square matrix, which has the Same 
number ofrows and columns. 

An array of numbers arranged in a single column is called a colx77272 vectom OF 
Simply a vector. 玉 the numbers are Set out in a row, the term 7row vector is used. Thus 
a column vectoris amatrix of dimensions7x 1 and arow vector can be viewed as a 
matrix of dimensions 1 x 7. 

We denote matrices by boldface, Upper case letters. For vectors we Use boldface， 
lower case letters. Here are examples of the notation: 


4 4 43 D1 


A=|4 4 423 b=| 22 (A9) 
431 43 433 Da3 
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Indices ofthe elements ofamatrix are displayed in the same order as its dimensions: 
therownumbercomesfirst followedbythe columnnumber Onlyoneindexisneeded 
for the elements of a vector. 


Transpose 
Thetranspose ofamatrixAis denotedbyA7L and defined as 
4 一 4 


The transpose operation thus interchanges the rows and columns of the matrix. 下 
applied to vectors, it turns a column vector into a Tow vector and Vice 7Ve1sd. For 
example, transposingAandb in Eq. (A9), we get 


4 42 43 
AT=|4s。 4 4 本 二 | 肌 D2 本 
4i3 423 433 


Anmx7matrixis said to be sy1z17etfriciAL = A.This means that the elements 
in the upper triangular portion (above the diagonal connecting 4lil and 4 of a 
Symmetric matrix are Imirrored in the lower triangular portion . 


Addition 
ThesumC=A+Boftwo1 xmatricesAandBis defined as 
Ci= .41 十 也 发 一 区 全 2 /人 了 2 (A10) 


Thus the elements of C are obtained by adding elements of A to the elements of B. 
Note that addition is defined onlyfor matrices that have the same dimensions，. 


Multiplication 


The scalar or dof prodrxctc=a.bofthevectorsaandb,each ofsize 1 is defined as 
172 

C= 》 akpx (Al]) 
雍 1 


It can also be written in the form c = a7b. 
The matrix product C=AB of an 1x710 matrx A and an 1 x7matrx B is 
defined by 


7 
(三 方 站 国 册 汪 二 下 入 了 二 2 (Al12) 
/一 1 
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The definition requires the number of columns in A (the dimension 7? to be equal to 
the number ofrows in B. The matrix product can also be defined in terms of the dot 
product. Representing the ;th rowofAasthevectorai andthe ith column ofB asthe 
Vector b) we have 


Ci 一 ai:b/ (Al13) 


Asquare matrix of special imnportance is the identity OFT V72 太 772C17X 


下 
0 1 0 0 
I==|10 0 1 0 (A14) 


Ithas the propertyAI = IA = 和 A. 


Inverse 


The inverse ofan 2 x1matrix A, denoted by A-l is defined to be an 7x7matrix 
that has the property 


A-IA=AA-I=I (A15) 


Determinant 


The determinant ofa sdquare matrixAis ascalar denoted by1Al or det(A). There is no 
concise definition ofthe determinant for a matrix of arbitrary size. We start with the 
determinantofa2 x2matrix, which is defined as 


4 4 


= 4i142 一 4i2421 (A16) 
421 42? 








The determinantofa3 x3matrixis then defined as 
4 4 43 


4 4 423| = 4 
431 43 433 


422 423 
43> 433 


421 423 
431 433 


421 4 


十 43 
431 43> 


一 -全 2 




















Having establishedthepattern, we cannow define the determinantofan 7 x matri 这 
in termas ofthe determinant ofan (7 一 1) x (2 一 1 matrix: 


用 
AI = 》(-D 呈 AM (Al17) 
/一 1 
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where Mi is the determinant ofthe (2 -JJ x(2-DJmatrixobtained by deleting the 
ith row and kth column ofA. The term (- TAIMis calleda cojactor of 4iK. 

Equation (Al7) is known as ZLCPljaces develop11zze1p1t of the determinant on the 
first row ofA. Actually Laplaces development can take place on any convenient TOwW. 
Choosing the ;th row we have 


用 
AI = 》(-D 和 AM (Al18) 
/一 1 


The matrixAis said to be si7gVLcr 让 |IAl = 0. 


Positive Definiteness 
An7x7matrxA4issaid to bepositive definite 让 
XLTAx> 0 (Al19) 


for al nonvanishing vectors X. It can be shown that amatrix is positive definite 计 the 
determinants of all its leading minors are positive. The leading minors ofA are the 7 
Square matrices 








4 4 …，4k 
4 4 …，4xk 
三 
4 4 …，AkK 
Therefore, positive definiteness requires that 
4 4 43 
4 4 
411 : 0， 有 4 4 0， 4421 .42 423 区 0， 家 全 14| 和 0 (A20) 
0 431 43 433 


Useful Theorems 


We list without proof a few theorems that are utilized in the main body of the text. 
Most proofs are easy and could be attempted as exercises in matrix algebra. 


(AB)7 = B7A7 (A21a) 
(AB)- = B-IA-1 (A21b) 
AI = IAI (A21c) 
IABI = IAIBI (A21d) 


ifC = AIBAwhereB = B7thenC = CT (A21e) 
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EXAMPLE A4 
Letting 
1 2 3 1 8 
外 三 小 二 冯 荆 U 一 6 了 三 0 
0 1 2 一 2 一 3 
computeu+Vvu:vwAvandu7zAv. 
solution 
1 十 8 9 
U 十 V 一 6 十 0 | 三 6 
一 2 一 3 =5 
u'V=1(8)) 十 6(0) 二 (2 人)( 一 3) = 14 
al.V 1(8) 十 2(0) 十 3( 一 3) 一 | 
Av=|azvi| =|1(8) 二 2(0) 二 1(-3) | = 5 
a3.V 0(8) 十 1(0) 十 2(--3) 一 6 
urAv=u.(Av=1(-D+6(05) 二 (-2)(-6) = 41 
EXAMPLE A5 


Compute |Al whereAis given in Example A4.ISApositive definite? 


solution Laplaces development of the determinant on the first row yields 


2 1 
一 浊 


1 1 
0 2 


1 .2 


IAl = 1 
0 1 


一 2 +3 




















=1(3) 一 2(2) 二 30 =2 
Development on the third row is somewhat easier due to the presence of the zero 


element: 


有 
了 


下 :3 
下 六 


1 2 


Al =0 
1 2 


一 】 十 2 




















一 0(-4) 一 1(-2) 十 2(0) = 一 2 


To verify positive definiteness，we evaluate the determinants of the leading 
Iminors: 


4i11 三 工 关 0 OK. 


4 4 
421 4 


1 2 
过 


一 0 Not O.K. 














Ais not positive definite. 
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EXAMPLE A6 
Evaluate the matrix productAB, whereAis given in Example A4 and 


一 人 1 
了 B 三 1 一 4 
2 一 2 
solution 
al.bl al.b> 
AB 一 a2.bl a2.b> 
as.bl a3.b> 


1 和 十 2 四 十 3 10D 十 2( 一 和 十 3( 一 外 生 会 13 
1(- 和 十 2 人 十 1C2) 10 十 2(- 和 十 1(-2)|=|0 -9 
0( 久 十 1 十 2() 00 十 工 一 和 十 2 一 当 9 





Index 


Adams-Bashforth-Moulton method, 296 
adaptive Runge-Kutta method, 277-284 
algebra. See linear algebraic equations Systems; 
matrix algebra 
ans, 5 
appendices, 411-419 
arraymanipulation, 21-25 
array functions, 23-25 
creating arrays, 6-8, 21-23 
augmented coefficient matrix, 29 


bisect,， 147-148 
bisection method, for equation root, 146-149 
brent, 151-153 
Brents method, 150-155 
buildqvec function, 15 
Bulirsch-Stoer algorithm, 288 
Bulirsch-Stoer method, 291 
algorithm, 288 
midpoint method, 285-286 
Richardson extrapolation, 286 
bulStoer, 288-289 


calling functions, 17-18 

cardinal functions, 104 

cell arrays, creating, 8-9 

celldisp,8 

character string, 9 

chaT, 4 

choleski, 48 

Choleskis decomposition, 46-52 

clLass, 4 

coefficient matrices, symmetric/banded, 55-66 
Symmetric, 59-60 
Symmetric/pentadiagonal 60-66 
tridiagonal 56-59 

command window, 25 


composite Simpsons 1/3 rule, 206 
composite trapezoidal rule, 202-203 
conditionals, flow control 12-14 
conjGrad, 88--89 
conjugate, 87 
conjugate gradient methods, 87-96， 
390-402 
conjugate directions, 391-392 
Fletcher-Reeves method, 398-402 
Powells method, 392-398 
continue Statement 15-16 
count_eVals, 368-369 
cubic splines, 115-121, 192-196 
culrve fitting. See interpolation/curve fitting 
cycjlic tridiagonal equation, 92 


data types/classes, 4 
char array, 4 
class command, 4 
dqoub]e array 4 
function handle, 4 
1ogical arTay 4 
deflation of polynomials, 174 
direct methods, 31 
displacement formulation, 77 
Doolittles decomposition, 43-46 
double arTray 4 


editor/debugger window, 25 

eigenvals3, 373 

eigenvalue problems. See symmetric matrix 
eigenvalue problems 

else conditional, 12 

elseif conditional, 12-13 

embedded integration formula, 277 

eps, 5 

equivalent equatiomn, 32 
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eITOT 
input 6 
in program execution, 16-17 
programming, 6 

Eulers method, stability of 274 

eValBrackets, 371-372 

evalPoly, 173 

evaluating functions, 18-19 

exponential functions, fitting, 131-137 


finite difference approximations, 182-187 
eIIOIS in, 187 
first central difference approximations， 
183-184 
frstnoncentral 184-185 
second noncentral 185-187 
first central difference approximations， 
183-184 
firstnoncentral finite difference 
approximations, 184-185 
fletcherReeves, 399-400 
Fletcher-Reeves method, 398-402 
fow control 12-17 
conditionals, 12-14 
loops, 12, 14-17 
force formulation, 79 
for ]oop, 14-15, 16 
fourth-order differential equation, 317-321 
fourth-order Runge-Kutta method, 260-261 
function concept 143 
function deftinition line, 17 
function_handle, 4 
functions, 17-20 
calling, 17-18 
evaluating, 18-19 
function deftnition line, 17 
in-line, 19-20 


gauss, 38-39 
Gauss elimination method, 34-42 
algorithm for 36-39 
back substitution phase, 36 
elimination phase, 35-36 
Imultiple sets ofequations, 39-42 
Gauss elimination with scaled row pivoting&， 
68--72 
Gaussian integration, 218 
abscissas/weights for Gaussian quadratures， 
223 
Gauss-Chebyshev quadrature, 224-225 
Gauss-Hermite quadrature, 225-226 
Gauss-Laguerre quadrature, 225 
Gauss-Legendre quadrature, 224 


Gauss quadrature with logarithmic 
singularity 205, 226 
determination ofnodal abscissas/weights， 
221-223 
formulas for 218-219 
orthogonal polynomials, 220-221 
gaussNodes, 227-228 
gaussPiv, 70-71 
gaussQuad, 228 
gaussQuad2, 238-240 
gaussSeide1, 82, 86-87 
Gauss-Seidel method, 84-87 
gerschgorin, 370 
Gerschgorins theorem, 369-371 
golLdBracket, 386-387 
goldSearch, 387 


Horners deflation algorithm, 174 
householder, 363-364 
householderP, 364-365 
householder reduction to tridiagonal form， 
359-367 
accumulated transformation matrix， 
363-367 
householder matrix, 359-360 
householder reduction of symmetric 
matrix 360-362 


fE, 12,，14-17 
il-conditioning, in linear algebraic equations 
Systems, 30-31 
indirect methods, 31 
了 ,5 
initial value problems 
adaptive Runge-Kutta method, 277-284 
Bulirsch-Stoer method, 291 
Bulirsch-Stoer algorithm, 288 
midpoint method, 285-286 
Richardson extrapolatiom, 286 
introduction, 251-252 
MATLAB functions for 295-296 
piroblem set 273, 291-295 
Runge-Kutta methods, 257-267 
fourth-order 260-261 
Second-order 258-260 
Stability/stifftness, 273-277 
Stability of Euhlers method, 274 
stiffness, 274-275 
Taylor series mmethod, 252-257 
in-line functions, 19-20 
input/output, 20-21 
printing, 20-21 
reading, 20 


integration order 237 
interpolation/curve fitting 
interpolation with cubic spline, 115-121 
introduction, 103 
least-squares fit 125-137 
fitting a straight line, 126-127 
fitting linear forms, 127 
polynomial fit 128-130 
weighting of data, 130-137 
fitting exponential functions， 
131-137 
weighted linear Tegression， 
130-131 
MATLAB functions for 141-142 
polynomial interpolation, 103-115 
Lagrange's method, 103-105, 108 
limits of 110-115 
Nevilles method, 108-110 
Newtons method, 105 
pioblem set 121-125, 138-141 
interval halving methods, 146 
inverse quadratic interpolation, 150 
invPower, 347 
invPower3, 374-375 
研 Or j, 5, 7-8, 9 


Jacobi, 333-335 
Jacobian matrix 238 
Jacobi method, 328-344 
Jacobi diagonalization, 330, 336 
Jacobi rotation, 329-330 
Similarity transformation/diagonalizatiom， 
328-329 
transformation to standard form, 336-344 


Laguerres method, 174-179 
LAPACK (Linear Algebra PACKage), 28 
least-squares fit 125-137 
fitting a straight line, 126-127 
fittinglinear forms, 127 
polynomial fitt 128-130 
weighting of data, 130-137 
fitting exponential functions, 131-137 
weighted linear regression, 130-131 
linear algebraic equations Systems. See CQ1so 
matrix algebra 
Gauss elimination method, 34-42 
algorithm for 36-39 
back substitution phase, 36 
elimination phase, 35-36 
multiple sets of equations, 39-42 
i-conditioning, 30-31 
introduction, 28 


iterative methods, 84-96 
conjugate gradient method， 
87-96 
Gauss-Seidel method, 84-87 
linear systems, 30-31 
LU decomposition mnethods, 42-55 
Choleskis decomposition, 46-52 
Doolittles decomposition, 43-46 
MATLAB functions for 100-102 
matrix inversion, 81-83 
methods ofsolution, 31-32 
notation in, 28-29 
overView of dqirect methods, 32-34 
pivoting, 66-81 
diagonal dominance and, 68 
Gauss elimination with scaled row 
pivoting, 68-72 
when to pivot 72-75 
pioblem set, 55, 75-81, 100 
symmetric/banded coefficient matrices， 
55-66 
symmetric, 59-60 
symmetric/pentadiagonal 60-66 
tridiagonal 56-59 
uniqueness of solution for 29, 30 


linear forms, fitting, 127 
linear systems, 30-31 
inInterp, 299 
logical, 11 

Jogical arTray 4 

loops, 12, 14-17 


工 U 
工 U 
工 U 
工 U 
工 U 
工 U 
工 U 
工 U 








dec, 44-45 
dec3, 58-59 
dec5, 63 
decPiv, 71-72 
sol, 45-46 
so13, 59 
sol15, 63-64 
SolLPiv, 72 


matInv 72 
MATLAB 


array manipulation, 21-25 
cells, 8-9 

data types, 4 

fow control 12-17 
functions, 17-20 
input/output, 20-21 
Operators, 9-11 

OverView, 1-3 

Strings, 4 


variables, 5-6 
writing/running programs, 25-26 
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MATLAB functions 
initial value problems, 295-296 
interpolation/curve fitting, 141-142 
linear algebraic equations systems, 100-102 
multistep method, 296 
numerical differentiation, 198-199 
numerical integration, 250 
optimization, 409 
Ioots ofequations, 180-181 
Single-step method, 296 
Symmetric matrix eigenvalue problems, 381 
two-pointboundary value problems, 324 
matrix algebra, 414-419 
addition, 415 
determinant, 416-417 
example, 418-419 
inverse, 416 
Imultiplication, 415-416 
positive definiteness, 417 
transpose, 415 
Useful theorems, 417 
matrix inversion, 81-83 
midpoint, 286-288 
modiftied Eulers method, 259 
multiple integrals, 235-248 
Gauss-Legendre quadrature over 
quadrilateral element 236-243 
quadrature over triangular element 243-247 


NaN, 5 
neville, 109-110 
newtonCoeff, 107-108 
Newton-Cotes formulas, 201-209 
composite trapezoidal rule, 202-203 
Iecursive trapezoidal rule, 204-205 
Simpsons rules, 205-209 
trapezoidal rule, 202 
newtonPoly,， 106 
newtonRaphson, 156-158 
newtonRaphson2, 161-163 
Newton-Raphson method, 155-160 
norm ofmatrix， 
notation, 28-29 
numerical differentiation 
derivatives by interpolation, 191-196 
cubic spline interpolant 192-196 
polynomial interpolant 191-192 
finite difference approximations, 182-187 
eITOIS in, 187 
first central difference appIoximations， 
183-184 
frstnoncentral, 184-185 
Second noncentral 185-187 


introduction, 182 
MATLAB functions for 198-199 
problem set, 196-198 
Richardson extrapolation, 188-191 
numerical integration 
Gaussian integration, 218 
abscissas/weights for Guaussian 
duadratures, 223 
Gauss-Chebyshev quadrature, 224-225 
Gauss-Hermite quadrature, 225-226 
Gauss-Laguerre quadrature, 225 
Gauss-Legendre quadrature, 224 
Gauss quadrature with logarithmic 
Singularity 205, 226 
determination ofnodal abscissas/weights， 
221-223 
formulas for 218-219 
orthogonal polynomials, 220-221 
introduction, 200-201 
MATLAB functions for 250 
multiple integrals, 235-248 
Gauss-Legendre quadrature over 
quadrilateral element 236-243 
quadrature over triangular element， 
243-247 
Newton-Cotes formulas, 201-209 
composite trapezoidal rule, 202-203 
Iecursive trapezoidal rule, 204-205 
Simpsons rules, 205-209 
trapezoidal rule, 202 
problem set 214-218, 233-235, 247-248 
Romberg integration, 210-214 


Operators, 9-11 
arithmetic， 
comparison, 11 
logical, 11 
optimization 
conjugate gradient methods, 390-402 
conjugate directions, 391-392 
Fletcher-Reeves method, 398-402 
Powells method, 392-398 
introduction, 382-383 
MATLAB functions for 409 
minimization along aline, 384-390 
bracketing, 384 
golden section search, 384-390 
piroblem set 403-409 
Overrelaxation, 85 


P-code (pseudo-code), 25 
斑 卫 二 
pivot equation, 35-36 


pivoting, 66-81 
diagonal dominance and, 68 
Gauss elimination with scaled row 
pivoting, 68-72 
when to pivot 72-75 
plotting, 26-27 
polynFit,， 128-129 
polynomial interpolant 191-192 
polynomials, zeroes of 171-179 
polyRoots, 176-177 
Powe]11, 394-395 
Powells method, 392-398 
Prandtl stress function, 245 
printing input/output 20-21 
PintSol, 254 


quadrature. See numerical integration 


reading input/output 20 
Tealmax, 5 
Fealmin, 5 
Iecursive trapezoidal rule, 204-205 
ITelaxation factor 85 
Teturn command, 15, 16 
Richardson extrapolatiom, 188-191， 
286 
zombeTrg, 212-213 
Romberg integration, 210-214 
Ioots of equations 
Brents method, 150-155 
incremental search method, 144-146 
introduction, 143-144 
MATLAB functions for 180-181 
method ofbisection, 146-149 
Newton-Raphson method, 155-160 
piroblem set 165-171, 180 
Systems ofequations, 160-165 
Newton-Raphson method, 160-165 
Zeroes ofpolynomials, 171-179 
deflation ofpolynomials, 174 
evaluation ofpolynomials, 172-173 
Laguerres method, 174-179 
Ioundofft error 187 
Runge-Kutta-Fehlberg formula, 277 
Runge-Kutta methods, 257-267 
fourth-order 260-261 
Second-order 258-260 
FunKut4, 260-261 
FunKut5, 280-281, 285 


Scale factor 68 
Scriptfiles, 25 
secent formula, 167 


Second noncentral fnite difference 
approximations, 185-187 
Second-order differential equation, 313-317 
Second-order Runge-Kutta method, 258-260 
Shooting method, fortwo-pointboundary value 
problems, 298-308 
higher-order equations, 303-308 
Second-order differential equation, 298-303 
Simijlarity transformation, 329 
Simpsons 1/3 rule, 206 
Simpsons rules, 205-209 
SortEigen, 335-336 
Sparse matrix, 101 
spD1lineCurv 117-118 
spD1lineEval, 118-119 
Stability/stifftness, 273-277 
Stability of Euhlers method, 274 
stiffness, 274-275 
stdDev, 129-130 
stdEForm 337, 338 
steepest descent method, 87 
stiffness, 274-275 
straight line, fitting, 126-127 
strcat, 7-8, 9 
Strings, Creating, 9 
Strum sequence, 367-369 
sturmSeq, 368 
SwapRows, 70 
switch conditional, 13-14, 16 
Symmetric coefficient matrix, 59-60 
symmetric matrix eigenvalue problems 
eigenvalues of symmetric tridiagonal 
matrices, 367-376 
bracketing eigenvalues, 371-372 
computation of eigenvalues, 373-374 
computation of eigenvectors, 374-376 
Gerschgorins theorem, 369-371 
Strum sequence, 367-369 
householder reduction to tridiagonal form， 
359-367 
accumulated transformation matrix， 
363-367 
householder matrix 359-360 
householder reduction of symmetric 
matrix 360-362 
introduction, 326-328 
inverse power/power methods, 344-352 
eigenvalue shifting, 346-347 
inverse power method, 344-346 
power method, 347-352 
Jacobi method, 328-344 
Jacobi diagonalization, 330, 336 
Jacobi rotation, 329-330 


到 辐 vdw 


symmetric matrix eigenvalue problems (co7t) 
Similarity transformation/diagonalizatiom， 
328-329 
transformation to standard form， 
336-344 
MATLAB functions for 381 
pioblem set, 352, 376-381 
Symmetric/pentadiagonal coefficient matrix, 
60-66 
Synthetic divisiom, 174, 151-153 


tay1or, 254 

Taylor series, 252-257, 411-414 
function of several variables， 

412-414 

function of single variable, 411-412 

transpose operator 7 

trapezoid, 204-205 

trapezoidal rule, 202 

triangleQuad, 244-245 

triangular 32-33 

tridiagonal coef6cient matrix, 56-59 

two-pointboundary value problems 
fnite difference method, 312-321 


fourth-order differential equation, 317-321 
Second-order differential equation, 313-317 
introduction, 297-298 
MATLAB functions for 324 
piIoblem set 308-312, 321-324 
shooting method, 298-308 
higher-order equations, 303-308 
Second-order differential equation, 298-303 


underrelaxation factor 85 


variables, 5-6 
built-in constants/Special variable, 5 
example, 5-6 
glLobal,5 


weighted linear regression, 130-131 
while loop, 14 
writing/Trunning programs, 25-26 


Zeroes ofpolynomials, 171-179 
deflation ofpolynomials, 174 
evaluation ofpolynomials, 172-173 
Laguerres method, 174-179 


